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Preface 


THE SUBJECT OF THE DESIGN OF EXPERIMENTS HAS BEEN BUILT UP 
largely by two men, R. A. Fisher and F. Yates. The contributions of 
R. A. Fisher to mathematical statistics form a major portion of the 
subject as we now know it. His contributions to the logic of the scien- 
tific method and of experimentation are no less outstanding, and his 
book The Design of Experiments will be a classic of statistical literature. 
The contributions of F. Yates to the field of the design of experiments 
àre such that nearly all the complex designs of value were first put 
forward by him in a series of papers since 1932. Both Fisher and Yates 
have also made indirect contributions through the staff of the statistical 
department of Rothamsted Experimental Station, since its founding in 
1920. It is not surprising that the contributions originated from Roth- 
amsted, because Rothamsted was probably the first place in the world 
to incorporate a statistical department as a regular part of its research 
staff, and the design of experiments is a subject that must grow through 
stimulation by the needs of the experimental sciences. A third group 
that has made considerable contributions since about 1937 is the Cal- 
cutta school, under the leadership of P. C. Mahalanobis. 

The first steps toward writing this book were taken about 1949, when 
the only books dealing specifically with the design of experiments were 
R. A. Fisher's Design of Experiments and F. Yates's Design and Analysis 
of Factorial Experiments. At that time I felt the need, particularly in 
teaching and also in consultation, for a book that would combine the 
very considerable literature on the design of experiments into a sys- 
tematic account of the subject from the point of view of both the user 
of the designs and the statistician whose duties are to consult in this 
field. ‘The basic requirements of the user of experimental designs have 
been satisfied by the book of Cochran and Cox entitled Experimental 
Designs. There remains, however, the relationship of the experimental 
designs to least squares and general linear hypothesis theory, the 
enumeration of designs, and various other topics which arise with con- 
siderable frequency. The proportion of instances in which the needs 
of the experimenter are satisfied entirely by an experimental plan, the 
analysis of variance and standard errors, I have found to be com- 
paratively low. The aim of this book has been to give a description 
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of the design of experiments from as broad a view as possible and to 
relate the subject matter of this field of statistics to the general theory 
of statisties and to the general problem of experimental inference. 

These remarks are the basis for the general structure of the book. 
Chapters 1 to 3 are entirely introductory and contain an attempt to 
give the place of experimental design in the whole field of statistics 
and a statement of the statistical theory which is basic to the inter- 
pretation of experimental data. Chapter 4 contains a very short intro- 
duction to the principle of least squares, an elementary understanding 
of which is essential to the experimenter, no matter how little he is 
interested in the basis of experimental designs. Chapters 5 and 6 are 
an attempt to cover in a systematic way general linear hypothesis 
theory and the least squares treatment of linear models, together with 
some closely allied problems such as the estimation of components of 
variance. In these chapters the processes can be described in fairly 
simple language, but a description of the proofs would be unduly long 
without the use of matrix notation. It is not particularly important 
to the user of experimental designs to be familiar with these proofs so 
long as he understands the processes and their theoretical basis, and the 
proofs are therefore given in matrix notation. The time is coming 
rapidly when workers in many fields of science will find a knowledge 

of the elementary properties of matrices essential to an understanding 
of the theory of their fields. Chapters 7 and 8 are concerned with the 
funetion of randomization and an attempt to give a complete account 
of the basis of the experimental designs with which the main body of 
the book is concerned. Chapters 9 and 10 comprise an elementary 
description of the two basie designs, randomized blocks and Latin 
Squares, and Chapters 11 and 12 a discussion of plot technique and the 
sensitivity of experiments. All the material up to and including Chapter 
12 is in a sense introductory, and, these matters having been disposed of, 
the remainder of the book is concerned with the development of designs 
in a logical order. This development is hinged fairly completely, with 
the exception of partially balanced incomplete block designs, on factorial- 
systems, and this is the main reason for the somewhat long discussion 
of the 2" factorial system. The last two chapters of the book are con- 
cerned with the analysis of groups of experiments and with designs for 
sequences of treatments. 

In a broad sense, practically all schemes of taking observations are 
part of the subject of the design of experiments. In this book attention 
is confined to experiments in which two or more treatments are being 
compared with preassigned replication. For example I have not dis- 
cussed the general problem of maximizing information which is described 


PREFACE ix 


oy Fisher in The Design of Experiments, or the possibilities of sequential 
analysis. 

The relationship of the material in the book to the content of courses 
at Iowa State College is possibly of some interest. For the last few 
years I have given a two-quarter course in the design of experiments 
to a rather heterogeneous group of students, all\of whom had been 
exposed to courses in statistical methods and some of whom had taken 
an elementary course in the theory of statistics. , The problems of 
teaching this group were an impetus toward writing this book. The 
analysis of variance is in many respects the most powerful tool that 
theoretical statistics provides; it is a comparatively simple technique 
from the point of view of computation and is of apparently wide appli- 
cability. The student of statistical methods tends to be one of two 
types; either he accepts the technique in its entirety and applies it to 
every conceivable situation, or he is more intelligent and questions the 
applicability at all. It is therefore necessary to discuss in some detail 
the basis of the technique and its scope of validity. It is also necessary 
to examine the inferences that are drawn from analysis of variance 
tests. As a result the course in experimental design consists of Chapters 
1 to 16 excluding the more mathematical portions, 19, 20, 22, and parts 
of the later chapters. There is little point in spending time in the 
classroom to describe computational processes for the complex designs, 
for, even if the student remembers them for his examination, he will 
soon forget them and have recourse to à text setting out the processes 
systematically. In writing this book I could have restricted myself 
to material that should be given in such courses, but it seemed preferable 
to attempt a more complete coverage, 80 that the interested student 
can pursue the subject to any desired extent. The course which covers 
the above material of the book is supplemented by problems, some of 
which consist of filling in simpler parts of derivations, and by a large 
number of sets of experimental data, chosen to illustrate particular 
points in the development. This is an essential part of the course, and 
it is preferable that the instructor provide sets of data with which he 
is familiar, so that the class can be given a picture of the motiva- 
tion behind the experiment, the reason for the choice of design, and 
80 on. 

The remainder of the book, apart from standard statistical theory, 
supplemented by the reading of papers, constitutes a course in experi- 
mental design for students whose aim is to become consulting statis- 
ticians with emphasis towards experimentation. I hope that the book 
will be of use not only to statisticians and prospective statisticians but 
also to biological scientists in general. 
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Some chapters are not elementary, though none of the material can 
be regarded as difficult from the mathematical point of view. It would 
perhaps have been desirable to give a more elementary treatment of 
some of the topics, but this would have lengthened the book unduly. 
"There is no intention to make simple matters complex, and, conversely, 
it is hoped that difficult matters have not been simplified to the extent 
of giving a false picture. There are several points that I regard as 
part of general statistieal theory, such as the non-central x? distribution, 
and there is little point in including such matters in a book on experi- 
mental design. f 

With reference to the method of treatment of experimental designs, 
there is always the possibility of making the assumptions of the pro- 
cedures in Chapters 5 and 6, and everything then follows in logical 
order. It was considered desirable, however, to examine the validity 
of these assumptions and the possibility of making less restrictive 
assumptions. Chapter 8 is concerned with this matter, and as a result 
the later treatment is based on a model that is termed the finite model. 
The results that are obtained are essentially the same as with normal 
‘law theory, except that randomization tests are assumed to be approxi- 
mated closely by normal law theory tests. In other words, the weight 
of the assumptions is shifted from the experimentalist to the statistician, 
the onus being on the statistician to show that normal theory tests are 
reasonably valid under wider circumstances. 

The help I have obtained from the general statistical literature is 
obvious, and, in addition to the writings of Fisher and Yates, the papers 
of Cochran, Neyman, Bose, Bartlett, Welch, and Pitman have been 
partieularly useful in formulating the pattern of development that is 
followed in the book. I have developed the subject in a way that 
seemed logical to me and have attempted to give acknowledgment for 
the original formulations. The proofs of general linear hypothesis 
processes in Chapter 5 are based on a development of the subject 
presented by Dr. G. W. Brown in a course of lectures at Iowa State 
College. 

I am indebted to Professor Ronald A. Fisher, Cambridge; to Dr. 
Frank Yates, Rothamsted; and to Messrs. Oliver and Boyd, Ltd., 
Edinburgh, for permission to reprint parts of Table V from their book 
Statistical Tables for Biological Agricultural Research. I am indebted 
to Professor E. S. Pearson, London, for permission to reprint the tables 
of the power of the analysis of variance test from Volume II of the 
Statistical Research Memoirs. 

I wish to thank J. Wishart and J. O. Irwin for introducing me to 
statistics. My debt to F. Yates as regards the material of the book 
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will be clear, but it is difficult to express completely my gratitude for 
the opportunity to work under him for some years. Without that 
experience and contact this book would certainly never have been 
written. 

Acknowledgment is due to former graduate students at Iowa State 
College, particularly A. M. Dutton, D. J. Thompson, M. R. Mickey, 
J. F. Hofmann, O. P. Aggarwal, and L. J. Tick, for reading parts of the 
book and going over some of the examples. In conclusion, I wish to 
thank Miss June Duffield for her patience and diligence in preparing 
the manuscript for publication. 

Oscar KEMPTHORNE 


December 1951 
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Introduction 


11 THE SCIENTIFIC METHOD 


The design of experiments must be regarded as an aspect of the scien- 
tific method, and we therefore start with a review of this method. It 
is not at all easy to give a concise definition of the "scientific method.“ 
Some have debated whether there is a method, rather than methods. 
The question of scientific methodology is not a trivial one, since the dis- 
tinguishing feature of science is its method. Much has been written 
on this general topic, and it is not proposed to take up this question 
here in any detail; rather a few of the most general and least contro- 
versial features of the scientific method will be given. 

A brief though adequate definition of scientific method would be the 
application of logic and objectivity to the understanding of phenomena. 
The essential feature of the scientific method is the examination of 
what is already known and the formulation therefrom of hypotheses 
which may be put to experimental test. The word "experimental" is 
the crux of the entire matter, for any question whose answer may not 
be obtained by planned observations is not in the realm of science. 
The ability to formulate hypotheses appears to be an individual char- 
acteristic, and, although many rules may be stated on the nature of 
appropriate hypotheses, the determination of the relevant aspects of 
the whole situation and the actual formulation of the hypotheses are 
a matter of intuition or genius. The next step is the examination of 
the hypotheses for consequences that are verifiable, and finally comes 
the objective verification. Verification of a theory cannot be absolute; 
we can only show that the observations are compatible with the theory 
within the limits of error to which the observations are subject. This 
somewhat negative approach, i.e.. being able only to prove a hypothesis 
false, is the major reason for the use of the il hypothesis in statistics. 
Science searches for a pattern which will embrace as many facts as pos- 
sible; that a theory may be used to give verifiable predictions in a wide 
range of circumstances is one of the bases on which it is accorded sup- 
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port. To use the words of Einstein: "The grand aim of all science 

. . is to cover the greatest possible number of empirical facts by logi- 
cal deduction from the smallest possible number of hypotheses or 
axioms." ! 

The circularity of the scientific method is perhaps not so widely 
recognized as it should be. This may be brought out by noting that 
it is only on the basis of hypotheses and theories that the scientist 
knows what to observe. Facts and theories are intimately intermingled 
and cannot be logically separated. That is to say, a fact is such only 
on the basis of some theory, and vice-versa. This statement holds 
very obviously in the physical sciences; in the social sciences the con- 
nection is not always clear but careful analysis shows it to exist. Herein 
lies the reason why science at any finite point in its development 
does not claim to provide the final answer. In the light of present 
theories new facts will almost certainly be discovered in the future. 
This will cause the abandonment or revision of these theories which in 
turn will render “facts” under the old theory no longer "true." New- 
tonian mechanics was able, in theory at least, to supply the answer to 
all mechanical problems for some 150 to 200 years, but a new theory, 
the general theory of relativity, was necessary to explain observations 
made with finer instruments, these very instruments being products of 
changing theories. 

The situation may be represented diagrammatically as shown in 
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Statistics enters at two places: 


1. The taking of observations. 
2. The comparison of the observations with the predictions from the 
theory. 


Statistics cannot on its own bring about new scientific theories, except 
in subject-matter fields that have a statistically formulated logical 
theory. Unless accompanied by the deductively formulated theory, 
statistics can only provide us with so-called empirical laws to which 
exceptions will be found immediately the laws are stated. 
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This pattern of the development of a subject-matter field is well ex- 
emplified by genetics. Starting from the theory ‘of independent segre- 
gation of genes, events could be predicted, and these led in turn to 
linkage theories, chromosome maps, and so on. 

It may reasonably be asked what other methods there are by which 
adjustment to nature may be achieved or for which such claims are 
made. In their book, Cohen and Nagel? list the following: the method 
of tenacity in which a theory or proposition is believed by closing the 
mind to all contradictory evidence, the method of authority in which 
appeal is made to some highly respected source—a person or a book— 
and the method of intuition in which obvious truth is claimed for propo- 
sitions. Whether this classification of other methods has any value 
may be doubted, but it can be used to determine how many so-called 
truths have originated. The essential point is that these "methods" 
do lead to the formulation of hypotheses, but the hypotheses cannot be 
accepted without experimental verification. They also lead, however, 
to belief in theories that cannot be verified at all. 


1.2 THE FORMULATION AND TESTING OF HYPOTHESES 


The formulation and testing of hypotheses are the important features 
of the scientific method, and some general ideas on this process may 
be given. In the first place, familiarity with the subject matter of the 
problem under investigation is absolutely essential, and, on the basis 
of previous knowledge, which may deal with situations that seem to 
be analogous, certain elements in the subject matter are regarded as 
significant and relevant. These elements are chosen because the in- 
vestigator is aware of theories dealing with these elements. Without 
some theories or ideas, the investigator will be unable to choose which 
elements in the situation to observe. A formal condition for a hypothe- 
sis is that it must be formulated in such a way that verification or lack 
of it may be achieved by direct observation with an experimental pro- 
cedure, or that deductions made from the hypothesis lead to predic- 
tions that may be verified. We shall make the distinction throughout 
this book between verification and proof. The idea of proof by pre- 
diction is, of course, fallacious; the basis of such proof is: If A (hypothe- 
sis), then B (prediction); B is observed, therefore A is true. By verifi- 
cation of a hypothesis, we mean the taking of observations and satis- 
fying ourselves that the observations could have arisen from a popu S 
tion specified by the hypothesis. We shall avoid the term "prooh 
except in a mathematical argument, for the above reason, and because 
of the fact that a hypothesis can only be disproved. 
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A hypothesis must provide the answer for the practical problem for 
which it was formulated and, in addition to providing an explanation 
of already-known facts, must give predictions of observations that can 
be verifed. It is of course essential, though frequently not realized, 
that the hypotheses and their outcomes should be formulated before 
verification is attempted. Hypotheses that are formulated from or 
modified by the observations are always suspect, and it is one of the 
elementary notions of statistical tests that probability statements can- 
not be made about statistical tests suggested by the data to which they 
are applied. It is possible that two or more hypotheses can give pre- 
dietions that are experimentally indistinguishable, and in such cases 
appeal has to be made to notions of simplicity, that a simple hypothesis 
is in general to be preferred to a more complex one, and to esthetic ap- 
peal, though the simplicity or complexity of a hypothesis may not be 
obvious and may depend on the frame of reference in which it is formu- 
lated. 


13 THE ROLE OF STATISTICS 


Reasoning is usually classified into one of the two types: deductive 
and inductive. Deductive reasoning is the determination of the con- 
sequences involved in a set of premises. It cannot therefore of itself 
add to knowledge of natural phenomena but can be used to aid the 
verification of theories based on a set of premises. Consequences in- 
herent in the premises may be deduced, and these consequences may 
be verified by observation and experimentation. Induction is the proc- 
ess of generalization, of drawing general conclusions from a particular 
set of instances. Such inferences depend on the particular set of in- 
stances being a fair sample of the population about which we make 
statements. It need not be emphasized that results obtained by induc- 
tion are not certain to be correct; they are probable, relative to a cer- 
tain body of evidence. The theory of statistics, which is entirely de- 
ductive, provides the basis for the inductive process. 

The role of statistics in the scientific method has been aptly sum- 
marized by Cramér? He states that statisties has three functions: 
description, analysis, and prediction. By description is meant the re- 
duction of a mass of data, say, the ages of all the individuals of the 
United States, to as small a set of numbers as possible. For this pur- 
pose we have quantities such as the mean, variance, skewness of the 
distributions, each quantity being called a statistic. The purpose of 
this condensation is not only to enable description of the population 
as concisely and briefly as possible, but also to enable comparison be- 
tween populations. The description of populations may be entirely de- 
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duetive, in the sense that we have all the relevant information for the 
whole population, or may be inductive, in that we have the information 
only for a sample of the population. The latter is of course the more 
frequent and is included by Cramér in the second function: namely, 
analysis: A second aspect of analysis is that, given a sample of ob- 
served values of a variable, we are asked if it could have arisen from a 
partieular distribution, or, given two samples which are differentiated 
in some way other than the measured characteristic, we are asked 
whether they could both have arisen from the same population. Some 
criterion must be used by which the possible difference in the two popu- 
lations can be tested, and mathematical statistics provides a rationale 
for choosing between criteria. Also included in the analysis function 
of statistics is the estimation of population characteristics from samples. 
It is assumed that the sample values have originated from a population 
that is specified mathematically in terms of certain quantities called 
parameters which, if known, enable the complete distribution to be 
specified. The problem is to obtain the best estimates of the parame- 
ters, where a mathematical definition of “best” must be specified. In 
the broadest sense, of course, estimation may be regarded as an aspect 
of the testing of hypotheses in which we have to choose from a number 
of hypotheses specified by the unknown values of the parameters. The 
third function of statistics given by Cramér is that of prediction, which 
is in fact the main aim of the application of the scientific method to 


phenomena. 


1.4 THE DESIGN OF EXPERIMENTS 


The general procedure in scientific research is to formulate hypotheses 
and then to verify them directly or by their consequences. This veri- 
fication necessitates the collection of observations, and the design of 
the experiment is essentially the pattern of the observations to be col- 
lected. , The consideration of the design of an experiment to provide 
evidence for a hypothesis necessitates careful consideration of whether 
the hypothesis is, in fact, capable of being verified or not. That the 

observations to be made are relevant to the hypothesis and capable of 
giving an unambiguous answer must be verified. Observations ob- 
tained in one way may be completely useless for testing the hypothesis, 
whereas those obtained in another way can be used for verification. 
For example, the hypothesis that the correlation between two charac- 
ters in a population has a particular non-zero value cannot be tested 
unless a random sample of the population is examined; whereas a sam- 
ple selected according to the values of one of the characteristics may be 
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used to test whether the correlation takes the particular value of zero, 
but not other values. 

The appropriate meanings of the word "experiment" as given in 
Webster's Dictionary are: “a trial or special observation made to con- 
firm or disprove something doubtful, especially one under conditions 
determined by the experimenter; an act or operation undertaken in 
order to discover some unknown principle or effect or to test, establish, 
or illustrate some suggested or known truth.” For some purposes it 
is useful to distinguish two types of experiments: absolute and compara- 
tive experiments? An example of an absolute experiment is the de- 
termination of, say, the electric charge on an electron. It was for such 
experiments as these that the theory of errors was originally devised. 
Repeated observations do not agree exactly with each other, and the 
problems considered were to obtain the best estimate and a measure of 
its reliability from a set of observations. The field of sample surveys 
is included by some writers as a branch of the design of experiments, 
and a sample survey may be regarded as an absolute experiment, the 
determination for a specified population of a particular characteristic. 

A comparative experiment, on the other hand, is an experiment in 
which two or more treatments are compared in their effects on a chosen 
characteristic of the population. In such an experiment the value of 
the characteristic under either treatment separately for the population 
is of no particular interest. The observations may not in fact be mem- 
bers from a single distribution, but we may have a different distribution 
for each observation on each treatment, and the hypothesis may be 
that the distributions are the same regardless of treatment, or we may 
assume the distributions to be of the same form regardless of treatment 
and wish to estimate the constant displacement of those for one treat- 
ment relative to those for the other treatment. This book is concerned 
mainly with comparative experiments which may be described as the 
taking of controlled observations, where control is effected on all varia- 
bles by the experimenter, either in actually fixing the variables, or con- 
trolling statistically by the process of randomization which will be dis- 
cussed in detail later. 

We may say that, in brief, the purpose of the theory of the design of 
experiments is to ensure that the experimenter obtains data relevant 
to his hypothesis in as economical a way as possible. The economie ' 
aspect of experimentation cannot be emphasized too strongly. The ex- 
perimenter is always in the position of being able to, or wishing to, 
spend only a certain amount of time, labor, money, ete., on his investi- 
gation, and it is certain that there are more-and less efficient ways of 
using these resources. No inductive inference is certain so that every 
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statement drawn from experimental data is subject to some error, an 
error about which probability statements may be made with the aid 
of mathematical statistics. A measure of accuracy is therefore obtain- 
able, and it is necessary as in all phases of practical life to consider the 
cost of obtaining a particular accuracy, whether it is worth this cost, 
and at what stage the cost of obtaining increased accuracy is too great. 

The real distinction between two of the applications of statistics, the 
design of experiments and sample surveys, is that, in the design of ex- 
periments applied to a problem, the populations that are studied are 
formed by the experimenter in a specified way, whereas, in a sample sur- 
vey dealing with the same problem, the population under study has 
arisen from a set of forces, the relation of which to the forces under 
consideration is unknown. A survey of a population tells us only about 
the objects observed and with suitable sampling schemes can tell us 
about a population of objects. It can demonstrate the existence of as- 
sociations between characteristics in the population, but the value that 
may be attached to a statement, for example, that attributes X and Y 
have a correlation of, say, 0.45 is somewhat dubious except as a descrip- 
tion of the population. All science is eventually concerned with the 
problem of how to make particular attributes of a population take on 
certain desired values. The existence of an association between attri- 
butes X and Y in the population in no way suggests that attribute X 
can be altered to a specified value by altering attribute Y in a particular 
way. In an experiment we determine whether altering attribute X has 
an effect on attribute Y, and this is the knowledge that is necessary for 
any action program. It is considerations of this type that nullify the 
value of much of the survey work that is done in fields where experi- 
mentation is extremely difficult. Survey work can be very useful in 
cases in which a deductively formulated theory exists and it is desired 
to estimate some parameters in the theory. It is however difficult to 
visualize how a theory can be started without some experimentation on 
which to base the original abstractions. 


1.6 THE USE OF PRIOR INFORMATION 


Up to several decades ago problems of estimation and testing of hy- 
potheses were solved only by utilizing assumptions about the distribu- 
tion of the unknown parameters. Starting with the work of Fisher of 
about 1920, the emphasis was completely in the opposite direction, the 
governing rule being that the sample data and only the sample data 


should be used in these statistical processes. For example, in estimat- 
ing the mean of a normal distribution, it was taken to be completely 
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incorrect to assume an a priori distribution of the mean, since no such 
distribution exists; in general, the unknown parameter has a particular 
fixed value, and it is incorrect to assume a distribution of the value. 
This led to the small sample theory of modern statistics. 

This theory is certainly more realistic for the purposes of inference. 
It should, however, be realized that, if we are not prepared to make 
some a priori assumptions, we can ascertain nothing: We do not in 
faet know what characteristics to observe and have no reason to ex- 
pect them to behave in any ordered way. Even when the use of a priori 
information was rejected, the experimenter had to produce his hypoth- 
eses so to speak “out of the hat.” 

The trend at the present time is then toward a more realistic ap- 
proach. There are considerable difficulties in the use of a priori infor- 
mation. Every experimenter will have different a priori information, 
and there is therefore no “objective” answer. We may say that one 
of the functions of statistical techniques is to abstract according to 
recognized rules the new experimental data. The experimenter then 
combines, by a process that is very little understood, this new informa- 
tion with his own a priori information. With the new information 
presented according to recognized rules any experimenter can reach his 
own conclusions. Naturally, as the body of new information increases, 
the experimenter relies to an increasing extent on this information and 
this only. This situation is realized best, perhaps, when the experi- 
mental data lead to conclusions that the experimenter feels are entirely 
erroneous; frequently, he will reject the data though sometimes he will 
be wrong in doing so. 

This branch of statistical inference is still very much in its infancy, 
and little can be said about it. The general position should, however, 
be recognized and realized by everyone. 


1.6 THE DECISION FUNCTION APPROACH 


In any discussion of scientific method and inference mention should 
be made of a new approach to the problem, originated by Wald * within 
the past few years. 

The starting point of this approach is the idea that we perform ex- 
periments or take observations only to give us a basis for further action. 
It is appropriate then to consider the possible types of actions, the risks 
involved in taking each action, and the probabilities of our data and 
statistical techniques leading to the various actions. Our aim will be 
always to minimize the expectation of our risk (or possibly in more 
complicated situations to minimize our maximum risk). In the sim- 
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ple situation of testing hypotheses, we would not then consider separat- 
ing the frequencies of type-I errors of rejecting the hypothesis when it 
is true and of type-II errors of accepting the hypothesis when it is false. 
We would specify the losses involved in each of these errors and mini- 
mize the expectation of our loss. "This approach is obviously the best 
one in any technological problem, for example, in the production and 
utilization of a manufactured product, and for this type of problem 
some useful results are being obtained. A difficulty in the application 
of this approach to scientific research is the specification of weights or 
risk functions for incorrect decisions. It is interesting to note, however, 
that the choice of randomization procedure for an experiment amounts 
to the choice of a randomized decision funetion. 
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CHAPTER 2 


The Principles of 
Experimental Design 


2.1 INTRODUCTION 


In this ehapter we shall indicate the general principles of experimen- 
tation without becoming deeply involved in statistical theory. A sta- 
tistically designed investigation may be said to consist of the following 
steps: 


1. Statement of the problem. 

2. Formulation of hypotheses. 

3. Devising of experimental technique and design. 

4. Examination of possible outcomes and reference back to the reasons 
for the inquiry to be sure the experiment provides the required informa- 
tion to an adequate extent. 

5. Consideration of the possible results from the point of view of the 
statistical procedures which will be applied to them, to ensure that the 
conditions necessary for these procedures to be valid are satisfied. 

6. Performance of experiment. 

7. Application of statistical techniques to the experimental results. 

8. Drawing conclusions with measures of the reliability of estimates 
of any quantities that are evaluated, careful consideration being given 
to the validity of the conclusions for the population of objects or events 
to which they are to apply. 

9. Evaluation of the whole investigation, particularly with other in- 
vestigations on the same or similar problems. 


\ 


22 AN ILLUSTRATIVE EXAMPLE 


Some of these steps may be illustrated by the following simple in- 
quiry. Suppose a person comes to us one day and says that he can 
predict whether a penny that we toss will fall heads or tails; we are 
naturally very skeptical of this claim and decide to test his ability. We 

10 
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assume that he is talking about an unbiased penny, that is, one for 
which the probability is V4 that the penny will fall with heads up and 
1% with tails up. Considering next the formulation of the hypothesis 
or hypotheses, we have to analyze the person's claims further. Does 
he mean that he will always be correct? If he does, our experimental 
procedure is quite simple; we toss pennies successively by some process, 
which we believe is random and which has been found to give results 
in accordance with random theory, and we stop the process when he 
makes a mistake. It should be noted that this hypothesis can never 
be proved, and it is true of all hypotheses that they can only be dis- 
proved. As a second example of this point, the law of gravitation 
states that the attractive force between two bodies of masses, m; and 


A : mim» 4 1 
ma at. distance r apart is y mu where y is a constant, but it cannot 


be proved that the power of r should be 2. If anyone suggested a value 
different from 2, it would presumably be possible to take sufficient, ob- 
servations to disprove the suggested value, but a limit on human Te- 
sources is reached such that, for example, the powers of 2 and 2.0000001 
are indistinguishable. The matter is resolved further on the basis of 
simplicity and practicality; for all practical purposes it may be suffi- 
ciently accurate to use a power of 2, even though the true power may 
be slightly different from that value. 

Suppose the person claims that he can predict correctly more than 
50 percent of times. Our first reaction to the person’s claim is that it 
is completely false and that his predictions will be randomly related to 
the actual results of the tosses. In this case we would set up the null 
hypothesis that his predictions have an equal chance of being right or 
wrong. To test this hypothesis, we have to decide on the size of the 
experiment, or the number of tosses. If we use 8 tosses we know that 
in the long run the number of correct answers out of 8, by chance, will 
be distributed according to the binomial distribution with n = 8, and 


P=: 


8 correct 1256 4 correct 19286 
7 correct $656 3 correct 56656 
6 correct 23286 2 correct 28236 
5 correct 56656 ] correct $656 

0 correct 1256 


If the person gives 8 correct answers, we have a considerable reason for 
rejecting the hypothesis that his predictions are, in fact, random, for 
the probability of his doing as well as this under this hypothesis is just 
lin 256. Two courses are open to us. We can decide either that an 
event with probability 1 in 256 has actually happened on a single trial 
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and the person cannot predict correctly, or we can decide that our origi- 
nal hypothesis was wrong. If we decide to reject the null hypothesis, 
or give credence to the person's claims, if he scored 8 successes we would, 
in statistical terminology, be using a significance level of 1 in 256. 

It should be noted that the level of significance has no relation to the 
probability of the hypothesis being true, and, in fact, no such proba- 
bility exists. We may well decide that a level of significance of 1 in 
256 is too high: if this level is used, the person cannot make any mis- 
takes, whereas his claim is that he can predict better than at random. 
We see that, if we allow him to make not more than one error, the 
probability of getting this result by chance is 9 in 256 or about 1 in 
28.4. It is a matter for the experimenter to decide what level of sig- 
nificance he should use, depending on the purpose to which his experi- 
mental results will be put and the importance of decisions based on 
them. If, for example, we are producing a drug that is dangerous in 
doses of greater than a certain amount, we shall require a high level of 
significance for the difference between the actual quantity and the spec- 
ified amount. Experimenters in biology and agronomy frequently use 
levels of significance of 1 in 20 and 1 in 100. The evaluation of levels 
of significance is highly important, but the tendency for uncritical use 
of 5 percent and 1 percent levels should be avoided. The choice of a 
level of significance in a particular investigation should depend on the 
null hypothesis and the alternatives, and on the cost to the experimen- 
ter of making erroneous decisions. Usually it is difficult to give these 
costs concrete values and a 1-in-20 or 1-in-100 significance test has some 
intuitive appeal. Levels of significance are a guide to the interpreta- 
tion of experiments but do not give the actual interpretation. They 
can, of course, be used absolutely in cases where experiments are per- 
formed very frequently and rapid objective decisions have to be made, 
but these circumstances do not usually pertain in the fields to which 
the design of experiments has been applied in the past. 

So far we have considered only the null hypothesis, that the person 
cannot prediet the results of the tosses. Alternatively he may claim that 
he will be correct in a proportion P of cases.. If we assume that for each 
toss the probability of the person giving the correct answer is constant, 
we may examine whether the results he has obtained after a particular 
number of trials are in reasonable agreement with his claims. We know 
that in n trials where n is large his actual percentage score should be in 
the range P — 1.96V P(1 — P)/n to P + 1.908 V/P(1 — P)/n, unless he 
has been unlucky to the extent of a 1-in-20 chance event happening. 
(The quantity 1.96 is the normal deviate which will be exceeded in abso- 
lute magnitude 1 in 20 times by a random observation from a normal 
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distribution with mean zero and variance unity.) We note that the 
probable range within which the actual result will be depends on the 
true proportion and on the number of trials. The relation to the true 
proportion is not of particular interest at this stage of the discussion, 
though in other cases it is of fundamental importance, and so we will con- 
cern ourselves only with n, the number of trials. The actual result will lie 
with probability of 95 percent within a range of 2 X 1.96 V — P)/n, 
which decreases inversely with the square root of n. The number of 
trials may be regarded as the size of the experiment, and the value of 
our information about the true proportion depends on this size. When 
the size is increased, the range becomes narrower. ‘This serves to illus- 
trate one aspect of experimental design: namely, that the experimenter 
must decide what accuracy he requires in his estimates and determine 
the size of the experiment accordingly. These concepts will be de- 
veloped in detail later. 

The essential part of the above argument is the formulation of the 
null hypothesis, which is couched in statistical terms. This hypothesis 
gives by mathematical arguments the distribution of the proportion of 
correct answers, and the actual result is compared with this distribu- 
tion. It should be noted that many tests of the hypothesis may be 
formed. For example, a specification of the probability of a correct 
answer with an assumption of independent tosses may be used to ex- 
‘amine the whole set of answers for chance deviations from what would 
be expected. This would involve what is called in mathematical texts 
the theory of runs. 

Exact statement of the null hypothesis is essential because this is the 
basis of the distribution of the observed results from which the test of 
significance is derived, A statement on the alternatives which the ex- 
perimenter considers possible is also necessary because without some 
specification of alternatives it is difficult to show that a particular test 
is a good one to use. For example, in the penny tossing we can think 
of no mechanism by which the person could get consistently less than 
50 percent of correct results, and therefore we use a test that is designed 
to discover percentages greater than 50: namely, the test based on the 
upper tail of the distribution. 

While we are discussing this simple example, it might be well to em- 
phasize the necessity of formulating the hypothesis before the experi- 
mental results are examined. Tests can be found, if one is sufficiently 
ingenious, which will, when applied to a particular set of random num- 
bers, indicate a deviation from randomness. Some of the results that 
one finds popularized on extrasensory perception appear to be subject 
to the criticism that the statistical tests were evolved in the light of th^ 
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data and are therefore suspect. On the other hand, it would be foolish 
to adhere too strictly to this rule. It is often diffieult to formulate the 
null hypothesis in strict terms without the data to which the statistical 
testis to be applied. Again, when the problem is one of estimation, the 
model or distribution that the observations are presumed to follow may be 
difficult to specify without examination of the data (cf. transformations). 


2.3 AN EXAMPLE ON FLAVOR DISCRIMINATION 


A second example which is very similar to the example given by Fisher 
in The Design of Experiments ' is the following, of which use is actually 
made in some food industries. A manufacturer is producing a drink 
according to some long-used procedure, and his technical staff discovers 
a method by which the procedure may be shortened. We suppose also 
that the modification of the procedure does not affect the constituents 
of the drink and that the important criterion is whether people can de- 
tect any difference in taste (or flavor) between the two products. It 
would be possible to broaden the inquiry and bring in the matter of 
preference, but this is a secondary question. A procedure that is fre- 
quently used is to present each of a panel of observers or tasters with 
3 glasses of the drink, 2 of them being of one type and 1 of the other, 
. and to observe whether each observer picks out the 1 drink that is dif- 
ferent from the 2like drinks. The null hypothesis that we are interested 
in testing is that no differences are detectable and that the odd one will 
be chosen at random in relation to the treatment. In order that the 
null hypothesis be satisfied when no difference exists, it is necessary 
that the association between the drinks, on the one hand, and the glasses 
in which they are placed and the order in which they are presented to 
the taster be zero: i.e., that these characteristics be chosen at random. 
This will be sufficient to ensure that on the average in the absence of a 
perceptible difference 14 of the trials will result in a correct selection 
of the odd drink, The random order is essential because the taster 
may tend for some reason to pick out the odd one just on the basis of 
order in which the 3 drinks are presented. 

A single trial does not provide any information of value, and so the 
test has to be repeated several times, If, for example, it is repeated 
6 times, the possible results with their probabilities are given by the 
binomial distribution with n = 6 and P = Ig, namely: 


6 correct M29 2 correct 240459 
5 correct 12720 ] correct 193429 
4 correct 59429 0 correct 8720 


3 correct 160549 
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If then a taster picks out the odd drink in each of 6 trials, there is very 
strong evidence against the hypothesis that the 2 types of drink have 
the same taste; and also if he picks out the odd drink correctly in 5 
out of the 6 trials, because this result or the one possible better result 
could be achieved by chance in only 13 times out of 729 or 1 out of 56 
times. Any smaller number of successes would not be regarded as in- 
dieating a difference, even though a small difference may exist. The 
smaller the difference in taste, the more trials will be necessary to detect 
it because errors will be more frequent. 

As mentioned previously, in all experimental designs it is necessary 
to consider the hypotheses alternative to the null hypothesis. If the 
difference is such that it is detected by the taster in 50 percent of cases 
on the average, will the test of significance based on the null hypothesis 
indicate that the null hypothesis is incorrect? We therefore consider 
the above test with regard to the alternative hypothesis that P = Ig. 
If the probability of being correct on any one trial is 14, the probabili- 
ties of the various results for 6 trials are: 


6 correct Mea 3 correct 2064 
5 correct 864 2 correct 1564 
4 correct 1564 1 correct $64 

0 correct. LE 


For the null hypothesis we decided that 5 or 6.correct results gave an 
indication of a difference in taste, and from the above it is seen that the 
chances of getting this result when the true probability of being correct 
is Ig are only 7 in 64 or about 1 in 9. We would therefore, on the basis 
of 6 trials, fail very frequently to notice a taste difference of the magni- 
tude considered, and we may describe the experiment as lacking sensi- 
tivity.. If the number of trials or replications is increased, the sensi- 
tivity will be increased. The experimenter must decide beforehand 
what differences he wishes the experiment to indicate and plan an ex- 
periment of such size that these differences have a high probability of 
being realized. 

This example serves well to bring out the concept of the power of a 
test. Our possible results may be represented by the points 0 to 6 on 


a straight line, say: Á 
Omi Bind: 6.6 


On the basis of the null hypothesis we select the results 5 and 6 correct 
as forming a critical region: that is, a region of the space of possible re- 
sults on which we decide to reject the null hypothesis. If the observed 
value falls in this region, we reject the null hypothesis. The chance of 
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our result falling into this region is a simple function of P, the proba- 
bility of a correct result on one trial, and we may evaluate the proba- 
bility of the observed result falling in this region for various values of 
P. The resulting relationship of this probability to P is called the 
power function of the test based on this critical region. In industrial 
statistics the same relationship is called the operating characteristic of 
the test. "This relationship tells us the possibilities of our test diserimi- 
nating between the null hypothesis and other hypotheses. Obviously 
' in constructing a test we should consider the alternative hypotheses 
and the chances of our picking out these over the null hypothesis. 

One way of increasing the accuracy and the sensitivity of an experi- 
ment is to increase the number of replicates or repetitions of the single 
trial. Broadly speaking, there are two other ways: (1) by changing 
the structure of the individual trial or replicate, and (2) by refinements 
in the experimental technique. 

So far the individual trial consists of 3 glasses of drink, 1 of one type 
and 2 of the other. We can visualize a whole series of possibilities, a 
total of 4 glasses with 2 of each kind of drink, of 4 glasses with 3 of one 
type of drink and 1 of the other, of 5 glasses with 3 and 2 glasses, re- 

. spectively, of the two types of drink. If we have 2 glasses of each type 
of drink presented randomly, the probability of matching them cor- 
rectly by chance is 4, as before. With 3 glasses of one kind and 1 of 
the other, the probability of being correct by chance is 4; with a given 
number of replications then the taster can afford to make more mistakes 
and still indicate a difference. With 3 glasses of one type and 2 of the 
other, the taster will be correct by chance in }{9, and such a trial is 
considerably more sensitive to departures from the null hypothesis. 
Changes in design of the above type may be fegarded as structural. 
This particular example is not, however, a good one for evaluation of 
structural changes, for we have no knowledge of the relative discrimina- 
tory ability in terms of proportion of successful choices for the various 
types of design. 

What we mean by refinement of techniques is the removal by the 
experimenter of differences between the two types of glass and drink 
that may confuse the taster and lower his discriminatory power. Thus, 
it is reasonable to specify that one type of drink should not be drunk 
out of the bottle while the other is drunk out of a glass and also, insofar 
as possible, the drinks, when presented to the taster, should have been 
poured in the same way and for the same period. There is no limit to 
the number of possible ways in which the experimental conditions could 
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be made more nearly constant, and the experimenter must decide how 
far he is prepared to go in this respect. 
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CHAPTER 3 - 


Elementary Statistical Notions 


It is not intended to give here a complete description of elementary 
statistieal theory; but it is worth while to note briefly the elementary 
statistical concepts and theory that are essential to the design and anal- 
ysis of experiments. It is assumed that the reader will have met these 
concepts before; if not, what follows may be used as a guide for study. 
'The text of Mood! may be mentioned as an excellent introductory 
mathematical one, or Hoel ° at a slightly lower level. 


3.1 POPULATIONS, DISTRIBUTIONS, PARAMETERS 


The first concept is that of a population. By a population we mean 
an assemblage of individuals, each of which may be an actual individual 
or an attribute of an individual: for example, the height of a corn stalk 
in a field of corn. The individuals of this population may be arranged 
according to the magnitude of a characteristie, and the function giving 
the relative frequencies of the different measurements is called the dis- 
tribution of the individuals. From this distribution we may obtain, 
'for example, the proportion with measurements less than a particular 
chosen value or the proportion lying in any chosen interval of values. 
A distribution may be discrete or continuous: for example, the height 
of corn stalks will be a continuous measurement and will give a contin- 
uous distribution, whereas the number of kernels per ear must be an 
integer and would have a discrete distribution. In most problems we 
envisage a population with a corresponding theoretical distribution. A 
discrete distribution is specified by the probability of each possible 
value: e.g., for an unbiased penny, the probability of heads and the 
probability of tails are both equal to Vg. A continuous distribution is 
specified by the frequency function, f(z), say, in which the probability 
of the variable lying in the infinitesimal range æ to x + Az is equal to 
f(x) Az. 

Distribution curves should be quite familiar to readers of this book, 
and so an example will not be given. Measures of central tendency or 


general position of distributions are the mean, i.e., the average value of 
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the attribute, and the median, i.e., the value of the attribute such that 
exactly 50 percent of the population have a measurement less than this 
value and 50 percent a measurement greater than this value. The 
mean is the more useful measure of central tendency, but the median 
has several important advantages over the mean, and the extent to 
which it is used is increasing gradually: for example, the median of a 
distribution is independent of the scale of measurement or rather varies 
exaetly with the scale of measurement, so that the median of the square 
roots will be the square root of the median of the actual values. If the 
distribution is symmetrical, the mean and median coincide. Another 
measure of central tendency of which little use is made is the mode, 
roughly, that value which is most frequent. The measure of spread of 
distribution that is almost universally used in experimental work is the 
variance, which is the mean square distance of the population elements 
from the mean. The distribution will not be specified entirely by its 
mean and variance, unless it is a normal distribution. Occasionally 
we may be interested in the mean rth power distance from the mean, 
that is, the moment of the rth order, usually denoted by ur. Also of 
use occasionally are the skewness or the extent to which the measure- 
ments are distributed unequally about the mean, usually measured by 
u3/u2%, and the kurtosis which determines the extent to which obser- 
vations are piled up around the mean, measured by (44/22) — 3. 

Any theoretical distribution is characterized by a mathematical form 
containing some quantities called parameters, and, when the values of 
these parameters are known, the distribution ean be specified com- 
pletely. The estimation of these parameters from sample data is one 
of the most important functions of statistical theory. A second im- 
portant function of mathematical statistical theory is the derivation of 
what may be called derived distributions: that is, distributions of func- 
tions of sample observations from known distributions: for example, 
the distribution of the mean of a random sample of size n from a nor- 
mal population and the distribution of the estimated variance. These 
distributions will, of course, also be describable in terms of the param- 
eters of the original distribution. 


32 THE NORMAL DISTRIBUTION AND DERIVED 
DISTRIBUTIONS 


The most important distribution in statistical theory is the normal 
distribution which has the frequency function 


1 EKR 


Jr) = N 


(1) 
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In this case the parameters are u, the mean, and &, the standard devia- 
tion. We can determine several quantities which may be used to esti- 
mate the parameters of a frequency distribution, and we generally wish 
to use, as the estimator of a parameter, that one which is subject to the 
least sampling variance. The quantity that best estimates the mean 
u of a population from a random sample of size n is the mean of the 
sample, &, and this estimate is itself normally distributed about u with 
a variance of c?/n. 

The function of the observations which is an unbiased estimate of c? 
and which is used in connection with tests and estimation is 


1 


Dr — 2)? 

ni 
where n is the size of the sample. This is usually denoted by 82, and 
(n — 1)s?/o? is distributed according to the x? distribution with (n - 1) 
degrees of freedom. The sample mean r and s? are distributed inde- 
pendently; that is, their joint distribution is the product of their in- 
dividual distributions. The explicit form of the x? distribution is 


»-1 /n—1 
27 (5 
2 
This is also the distribution of the sum of squares of (n — 1) variates 
distributed independently according to the normal distribution with 
mean zero and unit variance. 

Tests of signifieince on two means of normal populations are based 
on Student's distribution. If æ is a quantity normally distributed about 
a mean of zero with a variance of o°, and we have an estimate s? of o°, 
such that n5*/c? follows the x? distribution with n degrees of freedom, 


independently of x, the quantity ¢ = z/s follows the ¢ distribution, the 
explicit form of which is 
n+ *) 
r ntl 


coe 


The distribution by which the means of several normal distributions 
with the same variance or independent estimates of variance of a nor- 
mal distribution are compared is the F distribution. If ms?,/o? and 
ns?» follow the x? distributions with m and n degrees of freedom inde- 


n-3 
EET (2) 
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pendently, so that s", and EA are two independent estimates of the 
population variance c? based, respectively, on m and n degrees of free- 
dom, the ratio F = s? /s?; is distributed as the F distribution, the form 


of which is 
T (= H *) ERN 
2 


m n m+n 
(0960) n + mF) ? 
2 2 ( 
In a similar way we have a test to determine whether several estimated 
variances may be estimates of the same common variance. This is 
known as Bartlett’s test, which states that if 8% 7 = 1, 2, «++, k, are 


independent estimates of the same true variance, based on n; degrees of 
freedom, the quantity 


— h loge Zit — Bn; loge 2 (5) 
17 (2 E -) $ 
3(k — 1) Naim n 


where n = En; is distributed approximately as x? with (k — 1) degrees 
of freedom. 


(4) 


Jan 


3.8 LINEAR FUNCTIONS OF NORMALLY DISTRIBUTED 


VARIATES 
If i, 29, ***, Zn are normally and independently distributed about 
means Al, ua, ***, un with variances a?i, 072, „ ny then any linear 
function of the z's, say, 
Ati + Yate K. T Anta (6) 
is normally distributed about a mean of 
Aun + Na E. ＋ Nu ‘ (7) 
with a variance of 
Mi^; + N 2075 + v^ + Ne (8) 


This rule is the basis of estimation of errors in most analysis of vari- 
ance work, as we shall see later. The'simplest example of its use is to 
give the distribution of the mean Z ofa random samplé zi, +++, Zn from 


ie f 


a normal distribution of mean » and variance *. For then d Ir and. 
= is ii 
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Mt = ua = u = h, M = mm M = n, so that 2 is normally 


distributed around u with variance —- Substituting s? for o°, we have 
n 


2 — 
that — £ is distributed as ¢ with (n — 1) degrees of freedom. Simi- 
% Vn 
larly the difference between the mean Fi of a sample of size n, from a 
population with variance c?^, and the mean tz of a sample of size ng 
2 
0 0 
from a population with variance o has a variance lx AC Tf the 
nı N 
variances are the same, o”, say, the variance of the difference i: 


1 1 
o? (— s ~). From this we may derive the ¢ test for this difference 
ny N 


when the common variance is unknown, because the total sum of 
squares within samples is distributed independently of Fi and #2 ac- 
cording to x?c?, with nı + n — 2 degrees of freedom, so that 


5 — 1 — Ka (ni + ng — 2)nina (9) 
V/Z(r Fi) + E(t — #2)? N (ni + no) 


is distributed as Student's ¢ with (n; + n; - 2) degrees of freedom. 
Tests of significance and estimated errors of regression coefficients may 
be obtained in the same way; the usual linear regression coefficient b is 
a linear function of the observed values: namely, 


x (ti — Byi 
oe [= - 51 


so that its variance is / (r — )?, and so on. 
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The concept of orthogonality of contrasts is essential. Suppose we 
are given a random sample of n observations from a normal distribu- 
tion, say, z;, Z2, ***, Any linear contrast among these observations 
may be represented by the function 


A = n, + Dota +++ ++ Anton 
with 
Ay + Ao T.. . M. =0 


OTHER DISTRIBUTIONS 23 


The variance of this function is, of course, (OM). Suppose we have 
another linear contrast B.given by 


B = mty + uoto E. unn 


Then the variance of B is (Tus), and the covariance of A and B is 
(DN. The correlation r between A and B is given by 


(Zi)? 


P= 9 2750 


(40) 


and the correlation is zero if Du = 0. The contrasts are then said 
to be orthogonal. In simple terms, this means that A and B will be 
distributed independently, and, if we use A to estimate one parameter 
and B to estimate another parameter, the errors in the estimation of 
the one parameter will not be related to the errors of estimation of the 
other parameter. The estimates are then said to be orthogonal. If 
the distribution is not normal, the quantities A and B will be uncorre- 
lated if the condition is satisfied, but not necessarily independent. 
Further definitions and ramifications of orthogonality will be dealt with 
later. & 


3.5 OTHER DISTRIBUTIONS 


The binomial, Poisson, and negative binomial distributions merit 
mention, as discrete experimental data frequently conform approxi- 
mately to one of these distributions. 

The binomial distribution gives the distribution of the number of 
successes in a number of independent trials, say, n; the chance of a 
success being constant, p, say. The probability of r successes is 


n! 


-———— po" where g 1— 
N s , 


P, 


The mean of this distribution is np, and the variance is npg. It is im- 
portant to note that the variance depends on the mean. With large n, 
we may regard the number of successes as being normally distributed 
around np with variance npg. Even for moderately small n, the proba- 
bility of a number r or less of successes is closely approximated by the 
probability of a variate less than (r + 14) from a normal distribution 
with mean np and variance npq. We have used Yates’s correction for 


continuity in inserting the 14. 
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For the Poisson distribution the probability of the observation r is 


m 
P, e — 
r! 


The mean of the population is m, and the variance of the distribution is 
also m. It may be noted that the binomial distribution tends to the 
Poisson distribution as n becomes large and p small, the mean np re- 
maining constant and equal to m. This distribution is realized in prac- 
tice when the underlying variation is binomial with low probability p, 
and a constant large number of binomial events is observed in a single 
trial. 

'The negative binomial distribution has been found to occur in many 
biological situations and can come about as a result of clustering (or 
contagion) among the "successes" of an otherwise binomial population: 
e.g., deaths of insects, number of insect bites per apple. It has the 


formula 
5 
P. = 575 i= 
z (unt. DT q p 


and has a mean of kq/p and a variance of kg/p?. This distribution 
also arises in inverse sampling from a binomial population and as & 
weighted average of Poisson distributions. 

When these distributions occur, it is not correct to treat the observed 
values as having a constant variance and, hence, treat them by the 
analysis of varianee. For this reason transformations of the data, 
which are discussed in a later chapter, are performed. 


3.6 ESTIMATION 


The main purpose of statistical techniques is to estimate properties 
of distributions and to test hypotheses about these properties. By the 
estimation of a property is meant the calculation from sample data of 
a quantity that will be taken as the value of the property for the popu- ` 
lation. There are, in general, many possible estimates of a property. 
Suppose, for example, we wish to estimate the mean of a normal dis- 
tribution, which is also the median. We can take the mean of the 
sample; the mean of the extreme members of the sample, i.e., the mid- 
range; or the median of the sample. "There are, of course, many other 
possibilities, and each of these functions of the sample observations is 
known as an estimator. We decide to use one estimator rather than 
another on the basis of considerations given below. 
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Estimation problems may be divided into two classes: parametric es- 
timation, which deals with the estimation of parameters of a distribu- 
tion, and non-parametric estimation, which deals with the estimation 
of properties of a distribution, the form of which is unspecified. In 
the latter case the methods are called distribution free. A possible 
non-parametric estimation problem would be estimating from a sample 
the shortest range in a distribution of unspecified form that contains, 
say, 95 percent of the probability. Sometimes a property of the dis- 
tribution given by a parameter can be estimated non-parametrically ; 
for example, in symmetrical distributions with finite variance the mean 
and median coincide, and we can estimate the population mean para- 
metrically by the sample mean or some other function of the sample 
values and non-parametrically by the sample median. Parametric es- 
timates are, of course, obtainable only when the form of the distribu- 
‘tion is known, in distinction to non-parametric estimates for which 
this is not the case. Most of the methods of estimation in current use 
are parametrie, but increasing use is being made of non-parametric 
methods, because less specification or none at all of the parent distri- 
bution is necessary for their use. We shall be concerned mainly with 
porametrie methods based on distributions of assumed form, or speci- 
fied sufficiently to allow a solution. ; 

Estimators can be classified according to various eriteria, the prin- 
cipal ones being: 

1. Consistency: the estimate tends to the true value with increasing 

size of sample. 

2. Unbiased: the expectation of the estimate is the true value. 

3. Sufficiency: the estimate contains all the information, in a par- 
ticular sense, in the sample on the value of the pa- 
rameter. 

' 4. Efficiency: the variance of the distribution of the estimate rela- 
tive to some standard. 


In experimentation, by and large, we like to have properties 1 and 2 
and then obtain as efficient, estimates as possible. This procedure is 
reasonable in that the comparison and averaging of results from different 
experiments are of considerable importance. Various methods of esti- 
mation are available, but we shall mention only three: the method of 
maximum likelihood, the method of least squares, and the method of 
minimum x’. 4 

The method of maximum likelihood briefly is as follows: Suppose the 
frequency function of an observation z is 


f(x; 01, 02, ) 
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where 01, 6», ---, are the parameters to be estimated. Then the likeli- 
hood of a sample of values, z;, £2, +++, tn, is defined to be equal to 


TT fees; 01, 02, ) 


The estimates of 6;, 02, , are those that maximize the likelihood, or, 
what amounts to the same thing, that maximize the logarithm of the 
likelihood. This method is asymptotically efficient, and the asymptotic 
variances and covariances of the estimates may be obtained. 

The method of least squares consists of taking, as estimates of the 
parameters, those values of the parameters that minimize the sum of 
squares of deviations of the actual values from their expected values in 
terms of the parameters: i.e., to minimize . 


Z[r; — E(x)? 


The method of least squares is intuitively reasonable when the devia- 
tions of the observations from their expectations are independent or at 
least, uncorrelated and are subject to approximately the same variance. 
If the deviations are subject to different variances, whose relative mag- 
nitudes are known, the method is modified by weighting each squared 
deviation inversely as its relative variance. In other cases the method 
of least squares can lead to entirely erroneous results, particularly in 
the presence of correlations of the deviations. If the deviations are in 
fact normally and independently distributed, this method is essentially 
the same as that of maximum likelihood. 

The method of minimum x? is used for frequency data, when we ob- 
serve that n; of a sample of size n have the ith attribute, i = 1, 2, . 7, 
and we postulate a law for the true proportions P;. The law will con- 
tain parameters, and to estimate them we minimize the quantity 


225b 52 
x = EUM "x 


with respect to variations over the parameters. This method is, like 
maximum likelihood, asymptotically efficient. For large samples the 
minimum x? is distributed according to the x? distribution with degrees 
of freedom equal to the number of classes minus the number of param- 
eters estimated. 

We shall give no illustrations of these methods at present. For most 
purposes of experimental design the method which is used is that of 
least squares because of certain properties of the problems. In these 
cases the least squares theory is closely allied to the topic in mathemati- 
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cal statistics known as general linear hypothesis theory. A brief intro- 
duction to least squares theory is contained in the next chapter. 


3.7 THE TESTING OF HYPOTHESES 


We have already covered the elementary ideas on the testing of hy- 
potheses, which briefly amount to the following: We formulate our hy- 
potheses, consider the possible experimental results we can obtain, and 
divide these into classes, and to each class we attach a conclusion. In 
the case of the null hypothesis we have two classes: If our results fall 
into one of the classes we accept the null hypothesis, and if they fall 
into the other class we reject the null hypothesis. Corresponding to 
the general procedures by which estimation is performed, we have a 
general procedure for testing hypotheses: namely, the likelihood ratio 
test. For this test, we maximize the likelihood over all the possible 
values of the parameters, obtaining L( Na-), and also over the possible 
values of the parameters specified by the hypothesis under test, obtain- 
ing L(wmax): The ratio L(@max)/L(Qmax) is used as a test criterion, and, 
when its distribution has been obtained, the upper p percent tail is 
used to give a p percent test. Many of the usual tests can be derived 
in this manner, even though they may have originated from estimation 
considerations. 

The ideal situation described above rarely exists. In spite of tests of 
significance, the experimenter tends to use at least three classes: If the 
results are in class A, say, he accepts the null hypothesis, if they are in 
class B, he rejects it, and, if they are in class C, he says he cannot make 
a decision and must perform another experiment. Such multiple-deci- 
sion problems have been formulated and examined in recent years pri- 
marily by Wald,’ but except in rather simple (from the point of view 
of the experimenter) cases the theory has not reached the stage where 
it can be applied readily. Furthermore, it is roughly true to say that 
the experimenter is less frequently interested in tests of hypothesis and 
is much more concerned with problems of estimation. In comparing 
two treatments, for example, the situation is usually that, if a sufficiently 
accurate trial were performed, a significant difference would be found. 
A difference between the two treatments may be assumed to exist, and 
the relevant question to the experimenter is how big this difference is, 
and this raises the problem of estimation. This should not be inter- 
preted as meaning that the experimenter has no interest in the testing 
of hypotheses, merely that the greater emphasis is on estimation. As 
we shall see, an examination of the sensitivity of experiments, which 
is an aspect of the theory of testing hypotheses, is very important. 
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3.8 INTERVAL ESTIMATION 


With the theory of estimation described earlier we obtain a point 
estimate with an estimated measure of its accuracy. The point esti- 
mate alone is of little value because we are in the position of having a 
sample of one from a population of which we do not know the spread. 
We do not know, therefore, how close we are likely to be to the true 
value. An estimate of the variance of estimates is then essential for 
all investigational purposes, because, in general, small variance of the 
estimate implies closeness of the estimate to the true value for the situ- 
ations we shall consider. 

However, we are more frequently concerned with making an interval 
estimate, by which we mean the calculation from the data of an inter- 
val such that we know the probability of this interval containing the 
true value. Such an interval is known as a confidence interval. I+ is 
possibly worth while presenting here in simple terms the arguments by 
which a confidence interval on the mean of a normal population is ob- 
tained from a sample of n values. We know that, if 


(z; — z)* 


22; 
See Ing uu y 
n n—1 


E — 
z is distributed as Student's ¢ with (n — 1) degrees 
3/Vn 


the quantity 
of freedom. 


We can then find the probability that the inequality —t < One «t 
is satisfied: namely, the percentage point p corresponding to the value 
of t in the table of the t distribution with (n — 1) degrees of freedom. 

Now this inequality can be written as 2 — ts/+/n < u < Z + ts//n. 
and the probability that the inequality in this form is satisfied is als. 
p. If then, having drawn a sample, we construct the interval 


2 —1%/ Vu to Z4 is/Vn 


and say that the true mean lies within this interval, the probability 
that our statement is correct is equal to p. It should be noted that the 
probability is not of the true mean lying in the interval, because the 
true mean is a fixed unknown value and has no distribution, but the 
probability is the probability of the interval, which is the random varia- 
ble, containing the true value. If we draw the conclusion that the true 
mean is in the calculated interval for each case we examine, we shall 
be wrong on the average in (1 - p) of cases. This, then, is a con- 
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fidence interval on the true mean. Most of the estimates that are ob- 
tained in the analysis of experiments are linear estimates, which are 
distributed with a variance that may be estimated, and for which Stu- 
dent's distribution may be assumed to hold. Examples will be given 
as they arise. 
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CHAPTER 4 


An Introduction to the 
Theory of Least Squares 


41 INTRODUCTION 


In this chapter we shall give an elementary discussion of least squares 
theory. This theory is basic to the subject of the design of experiments, 
and the material of this chapter is given with the hope that readers 
who are not mathematically minded will obtain sufficient insight into 
the process to appreciate the two succeeding chapters. 

As we have noted in earlier chapters, the basis of the analysis of ob- 
servational data is the formulation of hypotheses, or what really amounts 
to the same thing, the postulation of a mathematical model. This 
mathematical model in the simpler cases gives a value for each observed 
result in terms of various quantities which are unknown parameters or 
"constants" (hence, the term “fitting of constants"). For example, 
suppose we have two treatments and have subjected several experimental 
units to them. We might have as our mathematical model that the 
yields y under treatment 1 are given by 


Yj = li ei (1) 


The subscript 1 denotes treatment 1, and j denotes the jth experimental 
unit that receives this treatment, / the true yield from the treatment, 
and ex; the deviation of the actual yield from the true yield. This devia- 
tion is due to the use of a particular experimental unit and the fact 
that our observation is subject to environmental or other uncontrolled 
causes of variation. Similarly, for treatment 2 we might have the model 


yoj = ta + €9; (2) 


the symbols being defined likewise. 

In order to specify our model completely, we must have some knowl- 
edge about the es: namely, how they are distributed. Suppose they 
are distributed normally and independently about zero with the same 
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variance c?, which is unknown. The quantities we wish to estimate are 
ti, tz, and to do this we use the principle of least squares: namely, to 
find the values of ti and tz, say, Ii and é, such that the sum of squares 
of deviations of the observed values from these values is a minimum. 
That is, we find the values f; and & which minimize 


Z(y; li)? + Z(yo; — b)? (3) 


where X denotes summation over the observed values. The values are, 
of course, 


P? 
fam. = N (4) 
n 
and i 
| b = yo. = — Zyoi (5) 
n 


Furthermore, from least squares theory, an estimate & of c? is given by 


: [x Qn; .) ＋ 22 (s; — v] (6) 


m + 2 — 215 : j 
Finally, we can say that fi = — Zyi; will be distributed normally 
n 


1 : 
around its true value with variance c?/m;, that f = — Zys; will be 


distributed normally around its true value with a variance of 9 / 2, 
and, as these are independently distributed, that i, — £5 is distributed 


ISA : 
normally around its true value with variance 02 (= + - Replacing 
1 


c? by its estimate &, we know that 


11 --h-d (7) 
1 1 
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where d is the true difference, is distributed according to the t distribu- 
tion with nı + nz — 2 degrees of freedom, this being the number of 
degrees of freedom on which s? is based. This is the ¢ test given in the 
previous chapter and is, of course, well known. We may therefore test 
the hypothesis that d takes on any value, and, in particular, if we put 
d equal to zero, we may test the null hypothesis that there is no differ- 
ence between the treatments. We may also obtain a 2 inter- 


val on d: namely, that the interval ts 
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has a probability of 95 percent of containing the true value d, 
tny-+no—2,05% being Student's t for n, + ng — 2 degrees of freedom and 
95 percent. 
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The above is a particularly simple example of general linear hypothesis 
theory. In general, the situation is given by a theorem due to Markoff. 
Suppose we have observations ya, a = 1 to n, say, which are distributed 
with constant variance and uncorrelated errors around a linear func- 
tion, say, baipi + baspa E.. bass of unknown constants pi, +++, Ps, 
the coefficients ba; being known; the best linear unbiased estimates of 
the unknown constants pi, ---, p, are those that minimize the sum of 
Squares 

E (a — baypi bazb: -= basPps)? (8) 
a 


The term “best linear unbiased estimate” should be explained. A lin- 
ear estimate of a parameter is a linear function of the observations, 
which is used to estimate the unknown parameter. Any function of 
the observations that estimates a parameter will be distributed in a 
particular way, as, for example, we can calculate the distribution of 
the mean of a sample from a normal population. This distribution will 
have a mean value, and, if this mean value is the true unknown value 
of the parameter, the estimate is called “unbiased.” The average of a 
number of independent unbiased estimates will tend with increasing 
number to the true value. We mean by “best” that the estimate will 
be distributed around the true value with a variance less than that of 
any other linear unbiased estimate. Finally, if the parameters pi, , 
p, are not connected by any relationships, we know that the quantity 


1 
2. 20. I bafi n a22 — ase)" (9) 


is an estimate of c?. 
As an example, eonsider the case of simple regression, where the model 
is 
yi = a Bri + ei (10) 


the e;'s being normally and independently distributed with a constant 
variance c?. We minimize 


Z(y; — a — pz)? (11) 
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and, by differentiation with respect to a and 8, we get the two equations: 


Zy; = nd + Bx, 
or 
y. = a+ br. (12) 
and : 
Zziyi = Dr: T Bzz?; 


Expressing & in terms of B and substituting the result in the second 
equation, we get 


Zry; = (Tr. B(Zz)z. + 822 


or 
32 Days — Cr. E(x; — 4.) (Yi 8 y-) (13) 
Dr’; me, (22,)x. D(z; ak a.) 
where 
1 1 
y. = —Zyi, . =- Er; 
n n 
Also @ = y. f., and the variance c* is estimated by 
1 
82 Z(y; — à — Bri)? 
n—2 
- By: — 9) = 10 (14) 
n-2 
= pq — yt fGr 2 — 10 
n—2 


The estimated variance of B is S/ (rt — 1.) 2, and confidence intervals 


on B are given by 
ts 


à - V D(t; AD zy 


As a second example, suppose we have the situation that we have 
observations y, assumed to be made up as follows: 


(15) 


5 = d e 
ya di + 2 + e (16) 
ys = a + 68 


where at, a; are unknown and the e’s are normally and independently 
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distributed around zero with constant variance 2. What are the best, 
estimates of a; and a)? We have to minimize 


(yy — a1)? + (ya — a1 — a2)? + (ys — a2)? 


Differentiating with regard to a; and equating the result to zero, we 
have 


yi — 41 + ya — di — d =0 
or (17) 
Yı + ys 24, + de 


Likewise, we have for a; the equation 
Y2 + ya = di + 242 (18) 
The estimates are then as follows: 
dj = 3(2y1 + 2y2 — yo — ys) 
= pn + y2 — Ys) (19) 
4 = 3 - (y1 + y2) + 20% + ya)] 
J - + y2 + 2ys) 
The minimum value of the sums of squares of deviations is 
(yi — 41)? + (ya — di — 4a)? + (Ys — ôa)? (20) 


and this divided by unity (equals 3 — 2): i.e., this quantity itself is an 
estimate of c?, which as usual we denote by s. 

It may be noted that this minimum sum of squares may be calculated 
very simply as Zy* — di(yi + y2) — da(y2 + ys). The corresponding 
general statements are given in the following two chapters. In brief 
the situation is that our equations for estimating the paraméters are of 
the form: 


L(y) — n(a) = 0 
hy) — g(a) = 0 
L(y) — gpa) = 0 


where each of the functions J;(y) are linear functions of the y’s, and 
g(a) of the parameters ai, az, d. Then the minimum sum of 


squares is 
Zy’; — d) — di 4, (00 


Finally let us consider the accuracy of our estimates. Each estimate, 
4, and ds, is a linear function of the observations, and its error is there- 


eto. 
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fore a linear function of variates, each normally and independently dis- 
tributed around zero with a variance a°. The variances are then 


var (4) = $(4 + 1+ De? = $e? = de? (21) 
var (dz) = $(1 + 1+ 9e? = $e? = $e" (22) 
and the covariance is 
cov (di, 42) = $(—2 + 1 — 2)? = - de? = 0 (23) 
Estimated variances are obtained by putting s? in place of o°, and we 
may then obtain confidence intervals on a; and on as. It is occasionally 
necessary to make,use also of a linear function of the parameters, say, 
oid; + aga. This function will be estimated by a4, + ado, and its 
variance will be 


o, var (di) + a? var (dz) + 20505 cov (di, da) (24) 


The subject of design of experiments is concerned to a considerable 
extent with situations analogous to the examples above, and a proper 
appreciation of the subject can hardly be attained without an under- 
standing of the process used. In the second example, the reader may 
find it instructive to examine other estimates of a; and dz. For ex- 
ample, the quantity y2 — yi estimates dz for 


Yo — Yr = d + d + e — 1 — € 
= d ＋ ez — ei 


The variance of this estimate of dz is clearly 20°, whereas the esti- 
mate we obtained by least squares has a variance of 302. Similarly, 
1% + y2 — yi) estimates do, and the variance of this estimate is 
4%, which again is greater than the variance of the least squares esti- 
mate. 
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The examples we have discussed are all of a certain type, in that the 
observation is a linear function of the parameters and the error. This 
is a rather specialized situation, though it is the one that occurs most 
frequently in the analysis of the basic designs. 

To illustrate a different situation, we shall discuss the fitting of the 
relationship 

yi = at b +e (25) 


where y; is the observation associated with z; (greater than or equal to 
zero), the quantities a, b, and c are unknown constants, the e;'s are un- 
correlated with a mean zero and constant unknown variance c?, and i 
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runs from 1 to n. Many examples exist of responses to amounts of a 
stimulus following this relationship in one form or another. The pro- 
cedure is to minimize the quantity 


n 
E (yi — be) 
i=l 
with respect to a, b, and c. Differentiating with respect to a and equat- 
ing the derivative to zero, we have the equation 


x (y; — a — bc) 20 (26) 


i=l 


Similarly, differentiating with respect to b, we get the equation 


Sc be =o (27) 
and, differentiating with regard to c, we obtain the equation 
E zib (y; — a — bc") = 0 (28) 
where, if x; equals zero, we put c*^' equal to zero. These equations 
may be written in the form: 


na + b(Zc*) = Ly; (29) 
a(Zc*) + b(Zc^) = Dy,c% (30) 
a(Zz,c ^) + b(Zz;c ^!) = Dym! (31) 


These equations are very tedious to solve, and some ingenuity may 
be required. If there is a small number of integral values of the z;, 
say, 0, 1, 2, and 3, the following procedure may be used. The equations 
to be solved will then be: 


4a + b(1 +c + è +) = Dy; (32) 
a(l Te +c? +c) + HH e e + 6%) = ys ye + ac? + ac 
(33) 


a(1 + 2c + 3c) + ble + 28 + 365) = y, + 2½ c + Bysc? — (34) 


By plotting the observed values we can make-a guess of c. Inserting 
this guessed value, co, say, in equations 33 and 34, we shall obtain two 
linear equations in a and b, of which the solution is a = ao and b = bo. 
We may insert these values for.a and b in equation 32 and then solve 
this equation for c, giving, say, cı. The whole cycle of operations is 
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then repeated until the estimated values for a, b, and c do not change 
appreciably. These final values will be the estimates of a, b, and c 
from the data. This procedure does not converge unduly slowly if the 
data conform reasonably to the law 25. Alternatively, we may con- 
sider the quantity 


Q= D- a- be%)? (35) 
7 
and note that the least squares estimates do, bo, and co, satisfy 
ð 0 ð! 
2 = 0, — z 0, 3Q =0 (36) 
da ðb ðc 
Now, 
aQ aQ 9?Q Q 
| =| +a- a| 0-5 
ðA lajyes ða labe abe ða ðb labe y 
aQ 
—c 
zi (co ) da dc abe 
ae í aQ aQ 
approximately, with similar equations for — and — , where 
laoboco ðC laoboco 
ð aQ 
?9 is the value taken by , when a = ao, b = bo, and c = ĉo, 
9a aoboco da 
aQ 35 Q 
andsoon. Guessing values a, b and c, we may evaluate jae ak oe 3 


ete., for these guessed values, and we shall then have three equations 
in the three unknowns (a — ao), (b — bo), and (c — co). If the solu- 
tions are a’, b’, and c, then a closer approximation to the estimates ao, bo, 
and co will be ay = a + a’, bo = b +b’, and co = c + c. The process 
is continued with these new values, until a cycle of operations produces 
little change. Approximate variances of the estimates can be obtained 
in a way analogous to that, which will be described in the next chapter 
for linear regression models. 

The reader will find that, if he wishes to fit this law, the fitting process 
is very laborious. Fortunately we shall not meet problems of such com- 
plexity computationally as this one for the bulk of this book, though 


one cannot avoid the problems in general, 
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CHAPTER 5 


The General Linear Hypothesis 
or Multiple Regression 
and the Analysis of Variance 


5.1 DESCRIPTION OF STATISTICAL PROCEDURES 


The basis of most parametric analyses of experiments is closely re- 
lated to the theory of the general linear hypothesis or, in other words 
that are probably more familiar to the readers, the theory of multiple 
regression. Simple cases were dealt with in the previous pages, and 
we now present a general description. 

Our assumption is that the observations y are expressible as linear 
functions of some known variables z;, «++, 4, with residual errors which 
are normally and independently distributed around zero with constant 
variance. The model is then 


Va = Bi*1 + Bote +++++ Bptp + ea (1) 


where 2}, 22, +++, tp take on particular known values for each ya, say, 
Tia, Z2a, ***; pa. Frequently we would let x, = 1 for all a. 
Throughout this book we shall be concerned not only with the deri- 
vation of estimates, designs, and so on for particular mathematical 
models but also with the applicability of these models to the real world. 
There are always certain relationships inherent in the mathematical 
model, which are clearly apparent to the mathematician though not 
necessarily realized when the model is applied to a set of data. We 
shall endeavor to keep the two aspects distinct from each other without 
ignoring either. The model we are discussing here is an example to 
illustrate these points. This model states that the regression of y on 
any one z; is linear with constant slope when the other variables x;(j * i) 
are kept constant, and also that the slope of the regression of y on z; 
is the same for all choices of the other variables. Suppose, for example, 
38 
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that we had two independent variables z; and 25, then for constant z» 
the relationship of y to 2; is given by Figure 2, the lines corresponding 
to different values of 22 being parallel, of positive or negative slope, of 
course. Similarly, the relationship of y to 22 is given by Figure 3, the 


| ee 
Be her 


FIGURE 2. FIGURE 3. 


lines corresponding to different values of z, being parallel. In applying 
the model 
y = By + Bote + € 


to a set of data, we are then excluding from the start the situation rep- 
resented by Figure 4. If we apply 
the above model to a situation such 
as this, we shall obtain an unrelia- xy low 
ble if not completely faulty picture 
of what is happening. In all the „„ 
discussion of models that we shall 
give, we shall be speaking in terms 
of the experimenter's aims, that is, 
what effects factors have, and so 
on, and not in terms of obtaining xi 
a representation of some population. Krause 4, 
A more complicated model could 
be used to deal with the situation described: e.g., one involving the 
product 27.2 possibly. 
To estimate the 8's, we use the method of least squares: that is, we 
minimize the sum of squares of deviations: 


xz high 


>> (ya — Bixio — Bsfsa — ^** — NE 


Differentiating with regard to £1 and equating to zero, we obtain the 
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first equation below, and, with regard to 8», 8s, , Bp, the succeeding 
equations: 


61 2710 4 BoZx1at2a ++ BpZX1atpa x: Daria 


GI riarza + G2 2a E. 4 BpZzostpa = Tiara à 
2 


P 


Bi ZA apa + BoZ2otpa +°** + ByZa oa = Zyatpa 


These equations are known as the normal equations. Let us suppose, 
also, as will be generally the case in regression problems, that our z;'s 
are not such that one or more linear functions of them are zero (for ex- 
ample, it is not the case that x, + z» = a constant). Then a unique so- 
lution to the above set of p simultaneous equations exists. In order to 
solve them, the following procedure is usually best. We first solve p 


sets of p equations, the first set of which we write as follows, using 
Sij = Sj; as an abbreviation for L xi: 


iSi + cd K CpSip = 1 


€1812 + 02822 T. 0582, = 0 M 


CySip + 0982, K CpSpp = 0 


Denote the solutions of these equations by c11, C12, ***, Cip, the first 
subscript indicating that this is the solution for the first set of equa- 
tions and the second subscript denoting the particular c solution. 
Now we solve these equations with the numbers 0, 1, 0, 0, ., 0 on 
the right-hand side: i.e., unity on the right-hand side of the second equa- 
tion and zero on the right-hand side for all the other equations, the 
solution being denoted by cal, C22, , Cap Similarly we solve the 
equations with unity at the right-hand side of the third equation, the 
fourth equation, and so on to the pth equation, in each case the right- 
hand side of all the other equations being zero. 

Arranging all our solutions we have a set of p? numbers which are 
arranged in a p X p square, the whole array being known as a matrix: 
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€11€12 *** Cip 


€C9122 *** Cop 


T VIE. E] 


cp * * * Cpp 


This matrix is the inverse of the matrix with S,; in place of ci; and may 
be obtained by other computational procedures. It will be found that 
cij = cji: that is, that the array of es is symmetrical about the leading 
diagonal. Then our solutions for B, Bo, **:, Bp are as follows: 


By = ci PI + ci Pz K cin 


Bo = c12P1 + Co2P2 K. CopPp 
(4) 


„ „ 


B, cp + CopP2 E. CppPp 


where P; is > Vatia- 
a 


We note that the c;j's are derived entirely from the 2;/s; that is, 
they are a function of the structure of our observational setup and are 
not related to the y’s or to the e's. The quantities estimating Ai, * * *; Bp 
are linear functions of the y's, for example: 


Br = yi (cnt + ox ct -+ Ciptp1) 


+ (e112 + Cioz22 +++ + Cıptp2) 


TATER E qe re © TA tov 


+ yn(Crrtin + clara K. CipTpn) 


The expectations of the 6’s are easily found to be the corresponding 5's. 
Furthermore the variance of B; is cn, and the covariance of any two 
B's, say, B; and Bj is ci. It should be noted that, for estimation pur- 
poses only, the assumption of normality and independence of the e's 
may be relaxed to the assumption that they are uncorrelated, retaining 
the assumption of zero mean and constant variance. 

An estimate of c? is derived from the sum of squares of deviations 
about the estimated values, in fact, by 


42 THE GENERAL LINEAR HYPOTHESIS 
1 

n—p 

This quantity is substituted in the expressions for the variances and co- 


variances of the estimates of the regression coefficients. The quantity 
$8? is more simply calculated as 


1 
n—p 


1 
Ie 5 Ri, B», 2 B70] (6) 
"np 


82 


E Wa — irie — bot2a - — Bptpa)? (5) 


(Zya — BP: — BeP2 —+++— B,P,) 
or 


where 
R(8;, B», zu Bp) = 28. P. 


is the sum of squares removed by the regression on 21, %2, % Zp. The 
results may be expressed in terms of the analysis of variance as shown 
in Table 5.1. 


TABLE. 5.1 
Variation Sum of 
Due to df Squares Mean Square 
2 
Regression p P» BP: (28;P;)/p = ge, 


Remainder n Difference (Difference) /n — p = 8” 


n 
Total n Sue 
T 


To test the significance of the regression coefficients jointly we evalu- 
ate the mean squares in the analysis of variance table and compute a 
variance ratio 8/2. Under the null hypothesis that the true regres- 
sion coefficients are all zero, this ratio is distributed according to the F 
distribution with p and n — p degrees of freedom. Alternatively, to 
test the hypothesis that the 6’s are, say, io, we compute the ratio 


3 (8; — Bio) (P. — D 


z ps? 


and this is distributed again according to the F distribution if the true 
B's are the Bio's. 

The above analysis is not exactly the same as that usually appearing 
in books on statistical methods, and the reason will appear shortly. 

A frequent problem in regression analysis is the following. We wish 
to test whether certain of the regression coefficients are zero without 
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making any assumptions about the remaining coefficients. Suppose we 
rename our regression coefficients BI, , Bg, Bois Batz: „ Bp, and 
we wish to test whether 8,41, 8g+2, ***, Bp could be zero. 
The procedure is simple: namely, to estimate the regressian coefficients 
in the model 
Ya = Bit + Bota . Baty + e 


obtaining, say, 8*, B8*», nu B*,. 
These 8*'s will be the solutions of the following set of equations: 


BiSi1 + 62812 +++++ BS. = Pi 
61812 + 62822 KP. B4824 = P2 
61819 T 6282 ＋ 8.890 = P, 
The sum of squares removed by the regression 2, +++, Xq is equal to 
R(B1, Bo, „ Ba) = 8*P1 + P E. 6% P (8) 


We can then construct the analysis of variance given in Table 5.2. 


(7) 


TABLE 5.2 


Variation Due to df Sum of Squares Mean Square 
Li 


Regression on 2}, ***, Ta d 2 BYPi Cy 


Regression on 2, „ Zp p 4. 
after fitting zj, ***, Zg D — 40 Y AP; — Y Sa 


Regression on zi, ***, Zp p > BiPi sp 
Remainder n—p Difference $ 
Total n zy 


To test the hypothesis that 541, +++, Bp are zero we utilize the fact 
that, under the hypothesis that they are zero, the mean squares 8, 
and s? are independent estimates of the same variance each distributed 
like x?s?, where c? is the true variance around the regression equation 
in zı, +++, 2, and the degrees of freedom for x? are p — q and n >p; 
respectively. The ratio s^,/s" will therefore be distributed as F with 
p — q and n — p degrees of freedom, and the test is made by reference 
to the F table. ! 

From the previous paragraph we may obtain the usual regression 
test. This test is devised to test whether deviations about the mean 
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have a regression on the independent variates. Our complete hypothe- 
m en Ya = Bits + Bata +-+ Bytp + ea 
and our restricted hypothesis that 

Ya = By +e 


where z, is unity for all the observations. The estimate 8*, is 5, the 
average y, and, with the complete model, we estimate the relationship 


tete Ya = (fj 522 — <- Gy) + Bore P. -+ Bpty 
where z; is always unity, and B, is equal to 
(g — Bas — Bats - u y) 


The analysis of variance corresponding to these two hypotheses is then 
as shown in Table 5.3. 


TABLE 5.3 
Variation Due to df Sum of Squares 
Regression on 2; (i.e., sum of squares 
due to mean) 1 D 
Regression 22, , Zp of deviations p-1 32(P2 — 22y) + (Ps — )) 
about mean Te BP, — £y) 
Regression on zi, ***, Zp p (g — Bata — - --— Byty)(Zy) 
+ ÊzP2 +--+ BpPp 
Remainder n—p Difference 
Total n zy 


The correction for the mean," y, with 1 degree of freedom, may 
be deducted from the total, and we are left with the analysis in Table 5.4, 


TABLE 5.4 
Variation Due to df Sum of Squares 
Regression on zs, +++, Zp p-1 2) 2e + Sage +++ fe 
Remainder n-p Difference 
Total n-1 Zy — N 


which is the more usual form, where we write Pze, for example, instead 
of Pa — 2y, to denote the sum of products around the mean. 


5.2 EXTENSION 


The above process may be extended in the following obvious way. 
Suppose we have a series of hypotheses, each nested within the suc- 
ceeding one, the models being 
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Ya = Biti + B22 +` ** + Bata + Ca 
Ya = Byti + Bote T.. 4 Bara + Beata Eoo Batrtatr + ea 
Ya = BX + foto E. Bata + BC G 
+ By prpitagrgr ett Batrtstatrts F Ca 


and so on. 
Corresponding to these hypotheses we shall have a partition of our 
degrees of freedom as shown in Table 5.5. 


TaBLE 5.5 
Variation Due to df Sum of Squares 
Regression on zi, ***, Tq q R(B1, Ba, , 89) 
Regression on 2941, , Tr after 
ži, „ Iq r Difference (= R, say) 
Regression on zi, . ., 2q Zot , Tetr qtr R(B1, Bo, +++, Ba+r) 
Regression on Tq+r+l, ***, Tq+r+e 
after zy, „ T7 8 Difference (= S, say) 
Regression on zi, , tq Zg4ly ** ^» 
Tatr, Tatrth „ Joker qtrt+s R(B1, Ba, ***, Barts) 
Remainder Ne E 
Total n 


Of the various hypotheses that can be envisaged, only a few can, in 
general, be tested. We can test the following, for example, supposing 
we have only the three groups of parameters given above and have ob- 
tained the above analysis of variance: 


1. All g's are zero: i.e., bı = Ba =t: = Batr+s = 0. 
2. Bai = 8j, „ Bars = 0. 
3. Bera = Bora moo = Baer = 0. 


The test of the hypothesis 
61 = 82 Batr+e =0 


is obtained by comparing the mean square for regression en xi, Zo, *** 


Tq 7 namely. 
R(&, Bo, ***s Boxer) 


qtrts 
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with the remainder mean square, E/n,, by the F test with (q +r +s) 
and ne degrees of freedom. 
To test the hypothesis 


Ba+ı = By+2 5 Botr+s =0 


we compare the mean square 


R(Bi, Bar [n = R(8:, 625 Ba) 
r+s 


with E/n, by the F test with (r + s) and ne degrees of freedom. To 
test the hypothesis 
61 = 82-57 = 0 


we would have to make a different order of subdivision of the analysis 
of variance in which the independent variates z;, +++, 4% are the last 
ones to be included. 

We can make any test of the following form: Is the regression on ti, 
£j, t5, Xp Significant after we allow, say, Xa, Tp, ***, Te to account for 
as much variability as they can? Alternatively we can test whether 
the regression on Ta, zy, ***, z, is significant after we allow zi, 2j, ++", 
zy to account for as much variability as they can. We can also test 
whether the sets of regression coefficients take particular values. As 
will be seen in the later section giving the proofs of these results, we 
cannot test for regression on 4 Tj, ++", z, merely by disregarding the 
other z's. Also, in general, we cannot say that a certain proportion of 
the variability of the y's is attributable to za, zy, ***, Te and a certain 
proportion to Xi, xj, «++, zy, and so on. If we characterize groups of 
the parameters, the 8's, by Yı, Y2, ete., we shall find, in general, that 
our estimates for any one group depend on assumptions made with re- 
gard to the other groups. For instance, if it is found that the regres- 
sion on a set of the independent variates 2 £j, +++, 7% is not significant, 
it might seem to be correct to calculate the regression on the remaining 
variates by ignoring z; £j, +++, zy. This amounts to assuming that the 
regression on 2½ zj, ***, zy is, in fact, zero. If this regression is not 
zero, the procedure mentioned would lead to biased estimates of the 
regression on the variates included. Only insofar as the bias introduced 
is negligible will the estimates be satisfactory. The bias may be evalu- 
ated in particular cases. 

There is also a difficulty in the interpretation of the regression coeffi- 
cients. Suppose we wish to estimate, from a set of observations of 
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rainfall, altitude, latitude and longitude, and the yield of a crop, the 
effect of varying independently each of these first 4 factors on the yield 
of the crop. It may well happen that in our data, rainfall and altitude, 
are very highly correlated so that errors in the estimation of the effect of 
rainfall are highly correlated with errors in the estimation of the effect 
of altitude and vice-versa. The extent to which this is important de- 
pends on the population to which the statistical results are to be applied. 
If in this population the same correlation exists, the correlation of errors 
of estimates may be unimportant. 


5.3 THE LIKELIHOOD RATIO TEST 


The tests of hypotheses which we have discussed are all derivable 
from the likelihood ratio test procedure. In the case of testing for re- 
gression on 2941, ***, tp, the maximum of the likelihood under the orig- 
inal hypothesis is equal to: constant (s?) /. Under the hypothesis 
that the regression on 2441, . p is actually zero, the maximum of the 
likelihood is equal to 


Constant [(n — p)? + (p — geal? 


L Ax, 
(Cmax) is then equal to 


E — ps + (p — ase 
Constant E 


The ratio 


max 


This leads to the variance ratio test on s?,/s? already given. 

In all cases of the linear hypothesis, the test criterion becomes the 
ratio of the minimum sum of squares of deviations under the hypothe- 
sis to be tested to the minimum sum of squares of deviations under the 
original hypothesis. The analysis of variance provides a convenient 
means of obtaining these minimum sums of squares and, hence, the 
mean squares. The mean squares are obtained so that we can use the 
tabulated F distribution. 


5.4 REDUCTION OF OTHER CASES OF REGRESSION 


Practically all cases of the testing of hypotheses on regressions may 
be reduced to the form already described. We shall give one example: 
namely, the testing of heterogeneity of several linear regressions. In 
this case we suppose that we have r sets of data, each set, denoted by i, 
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consisting of a number of observations on y and x. For the ith set we 
have the model 1% = es Big eg 


where y;; and z; are the jth (j = 1, 2, ---, ni) observations of the de- 
pendent and independent variables, respectively, in the ‘ith set. We 
may wish to test equality of the o's, of the 8's or of both for the sets of 
data. Suppose we wish to test the equality of the 6’s, making no as- 
sumptions about the a's. The model may be written 


Vu = 04% + 022 K. Oz, + 21181 + 082 K 067 + e 


Vim = Ge + Ozz T. Oz, + iii + 082 +--+ 06, + eins 


Yor = 02) + azza E. Oz, + 081 + 12162 KP 08, + ezi 
Van. = Ozi + azza +° -e+ Oz, + 081 + 12,2 P 08, + Cons 
Yn = Oz, + Ozz +-+ are, + 08; + 082 KP. 4,187 + er! 


Vr, = Ozi + 022 T. ＋ ar, + 081 + 062 T Von Br + ern, 
where 21 = 1 for observations in the Ist set 
= 0 for all other sets 
29 = 1 for observations in the 2nd set 
= 0 for all other sets 
and so on. 


We wish to test the hypothesis 6, = 8» K» 8,, and this will pro- 
ceed as in the general case. 


It may be verified that the test reduces to an analysis of variance of 
the form shown in Table 5.6. 


TABLE 5.6 
Due to df 
Separate a's and a common g rl 
Difference r-l 


Individual regressions 


Remainder Zn; — 2r 


Total about zero Zn 
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TABLE 5.7 
Due to df 
Common 8 1 
Difference r-1 
Individual p's r 
Remainder Zn; — 2r 
Total within sets Zn —r 


This analysis may be reduced further to the form given in Table 5.7, 
where 
Total within sets L (yj — yi? 
ùj 


Sum of squares due to individual regressions 
[x Wij — yii — 150; 
1 
7 25 (x — Ti)? 
J 
Sum of squares due to common regression 
[x ze (yij , — aJ 
t 7 
22269 mJ 
C ud 


1 1 à 
yi- being — J Vi and z;. being — J rij. Other cases may be examined 
ni j nj j 


easily by the same procedure, though the reduction to analysis of vari- 
ance form is not always immediately obvious without some practical 
experience. 


5.5 ORTHOGONALITY 


If our data conform to a certain pattern, we do not become involved in 
the difficulties of estimation and testing of hypotheses about the parame- 
ters mentioned earlier, This is so when the estimate of any one parame- 
ter of one group is uncorrelated with that of any parameter of any other 
group. In other words our c matrix, which when multiplied by c? gives 
the variance-covariance matrix of our estimates, may be arranged so 
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that it is of the form: 


Yi Y2 AREE et 
— — — — — 
r 
ir: 0 0 0 
* 
e 
72 0 e 0 0 
1 
* 4 
Y3 0 0 $ 0 
11 * 
Here yı, yo, ++- denote the groups of parameters, and the matrix is 


such that, when the rows and columns are arranged so that those corre- 
sponding to yı are contiguous, those for yz contiguous, and so on, the 
elements of the matrix are zero, apart from the elements corresponding 
to each group of parameters. 

If this is the case, it is easily proved that the estimate of yı, say, is 
unaffected by whether we first estimate the parameters of any or of all 
of the other groups. The proof is, in fact, obvious when we consider 
the equations for estimating all the parameters. The matrix of the 
coefficients in the least squares equations will be of identical form with 
the c matrix, so that we get the same equations for estimating the param- 
eters of the group yı, regardless of whether we also have equations for 
estimating the other groups. Likewise, the total sum of squares re- 
moved by the regression may be partitioned to give an analysis of vari- 
ance of the form shown in Table 5.8. 


TABLE 5.8 
Sum of Mean 
Due to df Squares Square 
n pi Sı 921 
v pi 81 s% 
Total due to Yh Yh °°! p 8, 8, 
Remainder n-p Se P 
Total n, DV 
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The expectation of each of the mean squares under the hypothesis 
that all the 6’s are zero is equal to c?, the expectation of the remainder 
mean square. If some of the parameters of the group yi, say, are not 
equal to zero, the expectation of 8°; will be c? plus a quadratic expres- 
sion in the parameters of ;, while the expectations of all the other mean 
squares will be c?. So, when the null hypothesis is false, the expecta- 
tions of the mean squares are: 


E(s)) = ° + Qin) 
E(s*2) = e? + Q(y2) 


E(s?.) = 0” 


Each of the quantities Q(y;), ete., is positive, except when all the pa- 
rameters of the group y; are zero, when Q(y;) is equal to zero. Each 
of these mean squares under the null hypothesis that the 8’s of its group 
are zero is distributed independently of each other as x!c?, where x” 
has the appropriate number of degrees of freedom. We may, therefore, 
test any of the groups using the F test with appropriate degrees of 
freedom. Our tests will not of course be independent because we shall 
be using the same denominator in all, and whatever deviation s^, has 
from c? will affect all the F tests in the same way. 

When the above situation exists, the pattern of observations is said 
to be orthogonal for these groups of parameters. In passing we note 
that: 


1. The orthogonality relates to the model we assume, in particular 
the assumption that the residuals of each y are uncorrelated (or inde- 
pendently normal) with the same variance. 

2. As a rough generalization, the importance of orthogonality de- 
creases with increasing quantities of data, providing the correlations 
are not close to unity. 

3. In many situations we wish to predict the result of increasing the 
level of one factor: The fact that we have independent estimates of 
each of the regression coefficients will be of no help, if we cannot alter 
the level of the one factor without altering the level of other factors. 
This tends to vitiate, more or less completely, the results obtained from 
the analysis by ordinary regression methods of many survey data. 
For the research worker usually resorts to the analysis of survey data 
when he is unable to perform experiments: that is, when he is unable to 
vary the factors himself at will. Consider for example the problem in 
farm management economies of assessing output y in terms of size of 


52 THE GENERAL LINEAR HYPOTHESIS 


farm zı, capital invested x2, and labor used zs, for a particular type of 
farming region. (We suppose the economie terms to be defined ade- 
quately.). Analysis of survey data by farms by the usual methods may 
result in an equation of the form 


y = a+ Bir + Bot. + Ga 


but the interpretation of this equation is in many cases almost entirely 
a matter of guesswork. Can we estimate, for instance, from this equa- 
tion the effect for an individual farmer of increasing the capital invested? 
On the other hand, it may be said in extenuation of the fairly frequent 
use of this method that it is of value in demonstrating the existence of 
relationships in the population studied, and this may be of real value 
to the research worker. The difficulties mentioned above have led in 
economics to the development of structural equations, which take ac- 
count of the interrelationship of the so-called independent variables. 


5.6 QUANTITY OF INFORMATION 


Emphasis has been made in several places on the economic aspect of 
experimentation. It is fairly easy to visualize the way in which the 
cost of an experiment could be calculated, though it might be difficult 
in particular instances to assess the cost of the various resources on the 
same scale, in terms of dollars, say. For to do this we have to put some 
value on the time of the experimenter as well as on the materials and 
hired labor. It might be a rather difficult decision to assess the value 
of a week’s work by the experimenter on an experiment. If he were 
not doing the experiment, what else would he be doing, and what would 
that be worth? Usually he is on a payroll and his salary will be paid, 
within limits, whether he performs the experiment or not. 

Supposing, however, that a reasonable cost function has been devised, 
what measure can we have of the value of his experiment? There are 
two aspects of the value of an experiment, to only one of which a«meas- 
ure of quantity of information can be attached. The aspect that can- 
not be evaluated except perhaps by the market value of the experi- 
menter is whether he has good hypotheses, good in the sense of leading 
to advances in knowledge. Suppose for example one is studying the 
nutrition of a child. Anyone with the vaguest of ideas on nutrition 
would be able to suggest various factors that might be varied in an ex- 
periment so that their effects could be estimated. The experimenter 
with the more original mind will suggest a more valuable set of factors 
to be tested and will devise techniques for their measurement. Noth- 
ing in statistical reasoning however suggests a method of ascribing a 
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measure to this value, except in the sense that the better experimenter 
will be able in the long run to predict a variable affected by many fac- 
tors with greater accuracy. 

The other aspect is this: Supposing the experimenter has decided on 
the factors to be investigated, is it possible to ascribe a measure of value 
to the various possible designs that are available? To make the dis- 
cussion more concrete, suppose the function of the experiment is to es- 
timate a single parameter. The only requirement that our measure of 
information should satisfy is that the information on a parameter pro- 
vided by, say, two independent samples from the distribution should 
be equal to the sum of the information contained in the two samples 
considered separately. This implies of course that the information is 
directly proportional to the size of the sample. The generally adopted 
measure of quantity of information js that originated by Fisher. 

Fisher defined the quantity of information, stated completely in math- 
ematical terms, as follows: Suppose we wish to estimate the parameter 
0 for a distribution f(x, 6), then the amount of information in a sample 


of size n is equal to 
* /QlogfV 
nl =n if fdx 
NE ald DE 


In the case of the normal distribution where we are estimating the 
mean py 


1 P. (z—4? 
qum erra Dt 
f(x) 3 
then . to grim 16 
ogf =- — logo 
xf 2 og (2v g 2 5 
and 
dlogf |f£—ph 
Ou ae 
80 that 1 
= — — 6 2 «m dz 
" 2 c! Vro 
n 
* 


he information per observation is therefore 1/0. In the case of an 
estimate that is normally distributed around its expected value, we use 
then the reciprocal of the variance of the estimate as a measure of the 
information given by the estimate. It is obvious that this measure of 
information has the required property, and intuitively this seems a rea- 
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sonable measure. For the variance of a mean of a normal sample of 
size n is /i, and of another sample of size nz is / nz, while the vari- 
ance of the mean of the combined sample is c?/(n, + nə). The infor- 
mation about the mean of the population is obviously contained en- 
tirely in the variance of the estimate, and the only function of this vari- 
ance that is additive for independent samples is the reciprocal. 

In the case of the general linear hypothesis, it was stated earlier in 
this chapter that the variance-covariance matrix of the estimates of 
the parameters was the c matrix multiplied by a°, and the obvious 
analogue for information in this case is the matrix which was inverted 
to give the c matrix: that is, the matrix of the coefficients of the linear 
equations which give the estimates. This matrix is often referred to 
as the information matrix. In general, we would use a volume based 
on this information matrix, usually that of the ellipsoid of concentra- 
tion. We saw above that it was desirable both for testing hypothesis 
and estimation that the c matrix be diagonal and, therefore, that the 
information matrix be diagonal. Our estimates are then uncorrelated, 
and we may consider the information contained in each estimate inde- 
pendently. 

Another measure of quantity of information is given by Wiener? in 
his recent remarkable book Cybernetics. This measure relates however 
to a priori and a posteriori distributions of the parameters and therefore 
appears of little value in the present context, though, when an a prior? 
distribution exists, it would be useful. 


5.7 PROOF OF THE RESULTS OF THIS CHAPTER 


In the proofs we assume that the reader is familiar with matrix nota- 
tion, which enables a considerably shorter presentation. The observa- 
tions and parameters are connected by the relation 


y=Xp+e (9) 
where 
yu 11141 Xp a [7 | 
Be . 
y = |Ya|' X-7]|zue2.«:zT|' B=j|: |* and e= Y 


Yn Tintin *** Lyn | 3, | ên | 
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The e/s are assumed to be normally and independently distributed 
around a mean of zero with variance 92. The sum of squares which is 
to be minimized is 


e'e = (y — XB)'G — Xp) 
= y'y — pXy-yXp- BX XG (10) 
= yy — 2y'XB + pX'XB 
Differentiating with regard to 8;, and denoting X'X by S, we get the 
equations 
SB = Xy 
Note that S is certainly non-negative, for any quadratic form u'Su = 
u'X/Xu = (Xu)'(Xu), which cannot be negative. 
If S is non-singular, 
í b = SNN (11) 
It is readily verified that the gts are unbiased, for 
E(B) = E(S^Xy) 
. = E[S?X (XB + €) 
= E(S^!Sp + S^!X'e) (12) 
esp 
The variance-covariance matrix of the estimates is equal to 
EÊ — B)(B - B)'] = E(S~X’ee'XS~!) since S = XX is symmetric: 
i.e, S = S 
= S-X'H,XS^ where Ip is the p X p unit 
matrix, since the e/s have 
zero mean and constant vari- 
ance and are uncorrelated 
= oS XXS 
= o SISS! (13) 
= gs 
It should be noted that S^ is the matrix c;; described earlier. 
Now we prove the property of *best linear unbiasedness." If the 
linear functions Ay are to estimate unbiasedly, we must have 
E(Ay) = E(AXB + Ae) = B (14) 
so, since E(e) = 0, the matrix A must satisfy 
AX =I (15) 
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The matrix (SX! + B) will satisfy this relation in place of A if 
BX = O, (16) 
where O, is a p X p matrix, all of whose elements are zero. 
(SA! + By 


is an arbitrary unbiased estimator of B, subject to this condition on B. 
The variance-covariance matrix of the estimates is equal to 


E[(SX' + Bee (XS! + B^] = c*(S!X' + B(XS-! + B’) 
= o°(S~! SX B! + BXS7! + BB’) 
= e* (S^! + BB’) (17). 


But BB’ is such that the ¿th diagonal element is the sum of the squares 
of the elements of the ith row of B. Any diagonal element of BB’ is 
therefore positive, unless all the elements of the row are zero. Any 
unbiased linear estimate of each 8; other than the one we obtained in 
equation 11 has therefore a greater variance. It should be noted that 
in this derivation we have made use only of the assumptions that the 
e’s have zero mean and constant variance and are uncorrelated. For 
tests of significance we use normal distribution theory, so that normality 
is also required. This, with zero correlation, implies independence of 
the e's. It is easily proved that the best linear unbiased estimate of a 


linear funetion of the parameters is the same linear function of the esti- 
mates of the parameters. 


To obtain the test of significance we note that 
(y — XBo)'(y — XBo) = (y’ — B’oX’)(y — XB») 
= ly’ - BX’ + (B’ — g'oX'lly — XB + X(B — 891 
= (y — BX’)(y - XB) + (y’ — BX X( — Bo) 
+ (P — B'o)X'(y - XB) 
+ (B’ — goxxi — Bo) (18) 


where Bo is an arbitrarily chosen set of 8,’s. Utilizing the fact that 


85 = X'y, ory'X = f/S, we note that the second and third terms (which 
are equal) are zero. The identity in 80 


(y — XBo)'(y — XB) = (y — XB)’(y — XB) + (B’ — B’o)S(B — Bo) (19) 
therefore holds. The first term on the right-hand side is the sum of 
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squares about the fitted regression equation. We found above that. 
Ê = B+ Se 


80 
y — XÊ = XB + e — XB XS Ne (I — XS X )e (20) 


This term is equal then to 1 
e'(I — XS XY) — XS Ne = e — XS^X^)e (21) 


and is a quadratic form in the errors e, regardless of the true B and Bo. 
The second term on the right-hand side is equal to (Bi, Ba, ***, Bp) 
of the first section of this chapter and equals 


[(B — Bo) + S?X'el'SI(B — Bo) + Se] 
= (B — Bo)’S(B — Bo) + 2(B — B)'S'Xe + e'XS^X'e (22) 
Now consider the two cases: 


1. Suppose Bo = B: i.e., the Bo,’s are the true values of 8;'s. Then, 


^ (y — XB) = e 
b e'e = e'(I XS Ne + e'XS'X'e (23) 
or 
Dee =A + % (24) 


1 


where Q; and O are non-negative quadratic forms in the e's. Qı is 
non-negative because it is equal to (y — XÊ) (y — XÊ), and O is non- 
negative because it may be written (X'e)S-!(X'e). The rank of the 
left-hand side is certainly n: the rank of Q» is less than or equal to the 
rank of S, and the rank of Q; is less than or equal to n — p, for Ci is 
the sum of squares of the quantities 


(y — Xf. 


which are connected by p linear relations, since X'(y — xf) =0. Be- 
cause the rank of the sum of quadratic forms is less than or equal to the 
sum of the ranks, it must be the case that 


rQ) = 
r(Q») =P 
We now use Cochran's theorem (see for example Cramér °): 


I 95 zh, = Qi + Qa +- 4 Qr where Qi, Qs, / Qr are non-negative 
1 


and 
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k 
quadratic forms of ranks 71, 72, ***; Tk and 2 ri = n, then there exists 
1 


an orthogonal transformation z — Oy, such that 


rir: 


Q = Èr 5 Q= 25 y^, ete. 
1 ril 


This is a theorem in algebra, and its value in statistics arises because, 
if 21, £o, . „ % are normally and independently distributed around a 
mean of zero with variance c?, then yı, ., Yn, Where x = Oy, O being 
orthogonal, are also normally and independently distributed around a 
mean of zero with variance c?. The quadratic forms Q; and Qz have 
then the distributions, 


Q = TAE , Q= N 


and the ratio 2 2 
p 
of freedom. 

The properties of the estimates and the fact that (Qi) = (n — pe? 
are known as the Markoff theorem, and it may be noted that the assump- 
tion of normality is not necessary for this theorem. The necessary con- 
ditions on the errors are that they have expectation zero, are uncorre- 
lated, and have the same variance. 

2. Suppose B ¥ Bo. Then, 


(y — XBo)’(y — XBo) = Qi + Q«(Bo) (25) 


Now Q, is exactly the same expression as before and is therefore dis- 
tributed as x^, ,c?. The quantity Qo(Bo) has an expectation of 


po” + (B — Bo)’S(B — Bo) 26) 
and, since S is positive definite, this expectation is greater than po’, 


if B = Bo. The ratio F = ae D. is then distributed as F, if 
B = Bo, and, if B * Bo, the numerator will on the average be greater 
than the denominator. The ratio F may therefore be used to test the 
hypotheses B = Bo, for deviations from the hypothesis will tend to 
make F large. The upper tail of the F distribution must be used as a 
critical region. From the point of view of computations, it is worth 
noting that equation 19, 


(y — XB)'(y — XBo) = (y — XH — XB) + (& — B’o)S(B — Bo) 


is distributed as F with p and (n — p) degrees 


THE TESTING OF A SUBHYPOTHESIS 59 
may be put in the form 
(y XB — XÊ) 

= (y — XBo)’(y — XB) — (B’ — B’o)X’(y — XB). (27) 
In words this says: 


Sum of squares of deviations from fitted regression = sum of squares 
about hypothesized true regression — > (8; — Boi) X right-hand side 


of ith normal equation] 


The test of the hypothesis B = Bo has been obtained essentially by 
use of the likelihood ratio test. It has been proved by Hsu, Simaika, 
Wald, and Wolfowitz that the test given above has optimum properties 
(see Wolfowitz ). 


5.8 THE TESTING OF A SUBHYPOTHESIS 


We now suppose that the parameters f, B, are divided into two 
groups yi, , Yq and à, , 8-4 80 that y = XB +e = XIV + X56 
+ e, where X; is the matrix composed of the first q columns of X, and 
X; of the last (p — q) columns, and 


yı p 
y-| |. 89 : (28) 


Ya Óp—q 


Suppose we wish to estimate Y and to test the hypothesis that y = Yo. 
We could assume 8 = ôo, and we would then have the hypothesis 


y-X-Xycte 
and, from the previous section, we would estimate y by 
90500 = (XIX) Xi — X280) 
This estimate is biased unless do equals the true value 8, for 
E[4(8)] NX Xl y + X2(8 — 59)] 
= y + QUX)7X,X(6 — 59 (29) 


Since, in general, we do not know 5, we must estimate both y and 6, 
and our estimates will then be unbiased. If, however, we know 5, we 
would be foolish not to use this information, for the variance of $(5) is 
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less than the variance of J (except with orthogonality of y and 6). 
This follows from the basic theorem on the best linear unbiased estimate 
and can be verified easily by noting that 


var (4) = var [$(8)] + var [4; — 44(8)] + 2 cov [45 4: Feld) 
and that it is easily found that 
cov [25 9; — $,(6] = 0 


the subscript 7 denoting any component of or $(6). 
The procedure for testing Y = Yo can be obtained by the likelihood 
ratio eriterion. Under the original hypothesis, 


Ho: y = XIV + Xô +e 
and, under the restricted hypothesis (or subhypothesis), 
H, : y = Xiyo + X5 + e 
where yo is known. The minimum sum of squares under Ho is 


(y XIV — Xob)'(y — Xi$ — X28) 


where 

Ri “t D 

= S7! (X; | X2)’y 

ê 

The minimum sum of squares under H, is 
ly — Xiyo — X2ô(Y0)l'[y — XıYo — X2ê(Y0)] 
where 
B(yo) NX X- Xx) 


The column matrix $(yo) denotes the estimate of 6, assuming that 
Y = Yo, 80 that 


8(yo) N XZ) X z — Xiyo) 
= (XX) XIX (y — yo) + X9 + e] 
KNX XXI — w)-5--(X;X)^'X,e — (30) 
But, from the identity 19, we have 
(y — Xiyo — X250)’(y — Xiyo — X280) 
= [y — Xiyo — Xob(yo)l'ly — Xeyo — X25(yo)] 
+ [8(yo) — &lX'2Xa[B(vo) — 8o) (31a) 
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and also 
[y — Xiyo — X26(yo)]ly — XıYo — X25(yo)] 
= (y — X4 — X:ô)'(y - Xi — X28) 
«| sail IM 40 ge 
so that we have the identity in yo and 8o, 
(y — Xiyo — X280)’ (y — Xiyo — X280) 


Lex XR QN Si t- Y 
= (y — Xi$ - Xob'(y — Ki? x) +[5" goo) Sle soe 


+ [8(yo) — 80)’’eX2[6(yo) — do! (32) 
(y — Xiyo - X280)’(y — XıYo — X28o) = Qi + Q2+Qs (33) 


As before, we now consider the various possible cases. 


or 


1. Suppose yo = y and 8) = ô. Then 
800%) = NX = Xivo) 
GN) !X,(58 + e) 
= ô + XX) ze (84) 


and 
B(yo) — 8 NN Ne 


ao] 29) - lo - a 


= S-*(X, | X2)'e — | 


Also, 


0 i 
(X'2X5) xal (5 


So Qo and Qs are quadratic forms in the e’s. The rank of Q; we know 
from before to be n — p, and the rank of Qs is less than or equal to q. 
The quadratic form Q» is equal to 


1 | 


xS [s-a | Xj'e — [sli 


| Stas | XZ) e — | 
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But 


0 
noue e 3 


xi /XiXi| XX; 0 
3 Es F i | xx) De o) 
X'e X^ X; (X'5X5) ze 
1 x) X'ꝛe | 
» [ee £ Rue vr 
0 


(36) 


so Q» is a quadratic form in only (p — q) linear functions of the e's and 
is therefore of rank less than or equal to p — q. Since the rank of a 
sum of quadratie forms is less than or equal to the sum of the ranks, 
the rank of Oz must be (p — q), and of Q3 must be q. 

We may therefore apply Cochran's theorem to give the result that 


Q; is distributed as x, 

Q» is distributed as xn, 
and 

Os is distributed as x?,c?, 
independently of each other. 


As a result, if we know the true values for y and 6 and compute Qi, 
Q», and Qs, any ratio of two of them adjusted according to their degrees 
of freedom follows the F distribution. 


2. Suppose yo 7* y and 80 »* 6. Then, analogously to equation 35, 
using equation 30 gives 


3 — Yo 0 
= $7 (X, Xe — xxu 
ls 31 10% q | a) : (X XZ) X ze 
Y ma 
+ er 
EU 5 — Yo) en 
The expectation of Qz is equal to 
NC i N | 
T NU L - yo) 


x s| Y — Yo | 
(NX) IX XIV — yo) 
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and, since S is positive definite, this expectation is greater than (p — q)o” 
unless yo = y. The quantity R(S ***, Bp) — R(Bq+1; Ba+2 85) 
of the previous section equals Q». 

Q2(Yo) Qi 
(p—9/ n 
that y = vo. This is true, regardless of whether 80 = 8 or not, because 
Qv is distributed as Xu in either case. For computational purposes 
we note that Ci is the minimum sum of squares with no restrictions on 
y and 8, and Q; + Qz is the minimum sum of squares with y = Yo. 
The quadratic form Qs which equals 


[$(yo) — 8o]'X’2X2l5(yo) — ol 


contains residual errors and the differences (y — Yo) and (6 — ôo), be- 
cause (yo) — do is equal to 


(X';Xj) IX XIV — Yo) + (6 — 89) + (X';X5) X ze 


If Yo and 8; are the true values of y and 8, the form Os is distributed as 
%%, but Qs is not distributed as x g if 8y = 8, but yo # y. 

Under one other condition the quadratic form will not contain terms in 
(y Vo), and that is when X'X, = O, for (X'5X5) ^ is non-singular. 
If this condition holds, 


8(yo) = 8 + NX) Xa 


and is the same as d, so that our estimate of Ê is constant, regardless of 
- assumptions about y. The converse statement also holds. Under these 
circumstances the quadratic form Qs has an expectation of 

qc? + (8 — 89)'X'3Xo(8 — 89) 

s / a 
which will be greater than qc? unless 8p = 8. The ratio DP zx 
may be used therefore to test the hypothesis b = b, if X'2XI = 0. 
This test will not be independent of the test y = Ye already given, be- 
cause the denominators in the two F values are identical. 

If the relation XXI = 0 holds, the parameters y and ô are said to 
be orthogonal. This property is, of course, a property of the data, and 
one of the functions of the design of experiments is to formulate a pat- 


tern of observations so that the condition holds. 
The extension to cases of a breakdown of B into more than two parts 


is obvious. The model will then be of the form 
y =Xiy + X25 + XP + Xu +--+ e (38) 


The ratio may therefore be used to test the hypothesis 
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and the groups of parameters are orthogonal if all products X';X; are 
zero matrices. 

These proofs can be easily adapted to deal with the situation when 
the e,’s are assumed to be normally and independently distributed 
around zero with variances bios, the kys being known. For, let 


1 
— 20 
Du Lue 
1 
0 — 0 EN. 0 
Vka j 
S 5 . (39) 


1 
Vin 


0 0 


then, 
Ky = KXp n (40) 


where the 's are normally and independently distributed around zero 
with the same variance o”. In non-matrix terms, if the model is 
Ya = Bitia + Bota Tec Bptpa + Ca 


and the e,’s have expectation zero, are uncorrelated, and have variances 
of kao”, when the kq’s are known, the best linear unbiased estimates are 
obtained by minimizing 


1 2 
Ys — Bitte — B —*** — Bptpa) (41) 


The solution may be obtained by either matrix manipulation on equa- 
tion 40 or ordinary differentiation of equation 41. A simple example 
of this case is the model 


y= fx+e 


where the e’s have expectation zero, are uncorrelated, and have a vari- 
ance of zo?.. We minimize 


1 
Z- (y — pz} 
r 


giving the estimate 8 / x, and so on. 
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These results may also be extended simply to the case when the eas 
have a known variance-covariance matrix A say, for we can then find a 
matrix P such that P'AP is the unit matrix. 


5.9 THE CANONICAL FORM OF THE GENERAL LINEAR 
HYPOTHESIS 


If the ea's of the model 
y-XBte 


are normally and independently distributed with mean zero and vari- 
ance 2, the joint distribution of the y’s may be transformed into the 
canonical form 


(m -a SG, E A] Ma 
We have seen that 
(y — XB)'(y — XB) = (y — XB)'y — XB) + (Ê — s — P) 
=Q +Q: 
Let Bo be the true value of B. Then, 
Ê — B = Se + Bo — B 

Also, 

(y - Xb'(y — Xf) == XS Xe 
There exists an orthogonal p X p matrix O such that 


M; 0 0 e. 0 * 
0 Mg 0 wee 
~ 
oso’=|" " ^ ELE 


0 i cm teat iene hig 


where Nai, Ms, «++, M, are the characteristic roots of S. Then 
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(Ê — BS(Ó —B) = ofs Ne + (Bo — BIA" LO[S ＋ (Bo — f)) 


p 
-2INau-2 (Gc 
i=l 


where 
= AOS^"X'e, 8 = AO(Bo — B) 


Suppose we fill out the (p X n) matrix AOS to an orthogonal matrix 


-ly’ 
P= (0. This is easily seen to be possible. Then if z = Py, 
n p 
we have that Oi = >> 22 Q = Ð (z: + ô)’, and the Jacobian of the 
i=p+1 pt 


transformation is unity. The canonical form is therefore obtained. 
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FURTHER NOTES 


It may be proved easily that least squares also has the property of giving a set of 
estimators with minimum generalized variance in the case of a linear model. The 
distribution of C/ , in the non-null case follows directly from the canonical form, 
the derivation being indicated in Chapter 12. 


CHAPTER 6 


The Analysis 
of Multiple Classifications 


Frequently experimental results consist of data arranged according 
to a multiple classification. "The methods of Chapter 5 are quite gen- 
eral and apply to this situation also. There are, however, several facets 
that require separate examination, and the more frequent cases of classi- 
fication data will be discussed in this chapter. In addition, the prob- 
lems of the estimation of components of variance will be considered. 


6.1 THE 2-WAY CLASSIFICATION WITH ONE OBSERVATION 
PER CELL 


For the 2-way classification the model is 
yi = u bi + tj + eij i 1, 2, r, „1, 2, 8 (1) 


where u, bi, and t; are the parameters, u + b; + tj is the expected value 
of y;;, and the e;'s are normally and independently distributed around 
a mean of zero with variance o°. We wish to estimate the b's and t's 
and to test hypotheses about them. We may write the model as a 
multiple regression hypothesis in the following way, 


Vi = ur + biti + bate rb ber, + n + taza K.. bate + eg 
(1a) 


where 
zo = 1 for all yi; 


zı = for all yj; with i = 1, and = 0 for all other y; 


12 = 1 for all yy with i = 2, and = 0 for all other y; 
68 
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and so on, and 
zı = for all % with ïj = 1, and = 0 for all other yi 
zp = for all y;; with j = 2, and = 0 for all other yi; 


and so on. In this formulation there are 1 + r + s parameters. The 
difficulty with this approach is that the matrix of coefficients has rank 
1 +r + s — 2, because z; + 2% . ＋ rr = 1, and 21 ＋ 224. 2 
= 1, for all %s. The matrix of coefficients of the normal equations is 
singular and, therefore, does not have an inverse. The hypothesis is 
said to be a hypothesis not of full rank. We do not need, of course, to 
have recourse to matrix theory to see that we have only r + s — 1 in- 
dependent parameters, for we can alter u by an arbitrary quantity, the 
b,’s by adding another arbitrary quantity the same for all b;'s and like- 
wise the ¢;’s, providing that these three arbitrary quantities add to zero, 
without altering the expectation of the observations. Unique solutions 
for the original parameters can only be obtained by imposing conditions 
on the parameters. , 

The linear hypothesis which is non-singular may be avoided from the 
beginning, but this results in the loss of the symmetry of the usual 
statement of the model and would lead to clumsy formulas. 

One way out of the difficulty is the following. We wish to test the 
existence of differences of the b’s and differences of the “'s, and whether, 
for example, taking account of u, the b's and the t's makes the estimates 
of the yield % namely, u + b; + tj, significantly closer to the observed 
value than taking account of u only. This leads us automatically to 
suitable linear conditions to impose on the b’s, because, with no restric- 
tions, the mean over the whole is an estimate of 


u T b. ＋ . 
We, therefore, regard this quantity as 4, and then have 
b'i =b; — b. 
t; -1;— bi 
with 
Tb“. = 0 
and 
St“, = 0 
and 
yg = 1 OE Ue (2) 


This process will be called a reparametrization of the model. 
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Straightforward application of least squares leads then to the follow- 
ing equations, where for the rest of this section the primes are omitted: 


For u: rsp =Y.. 
For b: sn + sb; = Y;. (3) 


For ¢;: rh ＋ ri, =Y; 
where 
V.. = È vij Y. È ws Y: 2 yg 
j i å ij 


We shall attempt to adhere always to the rule of notation that the sum 
over some subscripts of, say, % . is denoted by the capital letter, say, 
Y with the subscripts over which summation is made replaced by dots. 


Thus, 
D yan = P. 
i,k 


We shall denote corresponding means by a small letter: e.g, ... 
The equations (3) are not independent, because the » equation can be 
obtained by adding the equations for the b's or the 's, since Zb; = Zt; 
- 0. 

To exhibit the orthogonality present in this situation, we must sub- 
stitute for one of the b;'s, say br, in terms of the others by the relation 


by ＋ be bp =0 


in the model, and in the normal equations 3, and likewise for one of the 
48, say ts. If now we subtract the b, equation from each of the other 
b equations, and the t, equation from each of the other t equations, we 
obtain the following set, of equations: 


rsü =Y 
f=] 


sb. +3 Obi = Yi. — V.., i=1,2,+--,r—1 (4) 
1 


a—l 


ri; LI =. - F., 1712 3-1 
1 
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of which the matrix of coefficients is 


A b 52 : : 5a i, h s 3 m 


tay 


These new parameters fall into three groups: 
yı consisting of u 
yz consisting of by, be, „ bi 
y3 consisting of ti, tz, * *; ts—1 


such that the groups are orthogonal. d 
Estimates of the parameters are easily seen to be 


Ys 
a= — 
rs 
da d 
8 (5) 
8 T8 
Ys Y 
* 
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The sum of squares accounted for by the parameters, which we may de- 
note by R(u, b, t), is 


AY.. + 2 b. V.. + MY; 
i j 


which equals 


Gee) a 


rs 


We therefore have the analysis of variance given in Table 6.1. 


TABLE 6.1 
Due to af Sum of Squares Mean Square 
Mean 1 Y*../ra 
b's 121 ZY5;./s — Y?../rs 
t's s—1 ZY?./r — Y?../rs 
Remainder (r — 1)(s — 1) By difference 
Total about: zero rs Byty 


Usually the term due to mean is subtracted from the total about zero 
to give what is then called the total sum of squares. 

So far this analysis of variance is an algebraic identity and can be 
made, regardless of assumptions about the origin and nature of the 
data. 

Supposing now that the b;'s refer to groups and the 4% to treatments, 
then we are interested in testing whether there are differences among 
the groups or among the treatments. To make tests of significance we 
must use the assumption that the e;j's are normally and independently 
distributéd with the same variance c? around a mean of zero. 

Under this assumption we examine the portions of the analysis of 
variance table: 


1. Due to mean: This quantity is equal to 


Y?. h 2 
Mo (w+ pa^ 
rs ij 


The expected value of this quantity is then 


rsu? + 92 
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2. Due to b’s: This sum of squares is equal to 
> b ES 


i 8 78 


: ya 
The quantity > za is equal to 
i 
Z[(su + sbi) + 27 eil*/s 
j 


and has expectation 


E s( + b)? + ro? = ry? ES C b. + ro” 


The expectation of the sum of squares due to the U's is then 
(= 0c +s Obe, 


If we define the variance of our original finite population of r b’s as 


(b; — 5. 
8 
S 
the expectation is (r 1) ( + 802%. The expectation of the mean 


square is then (c? 4- 3075). 
3. Due to t’s: Similarly the expectation of the mean square due to the 


’s is o? + ro”, Where a% is defined by 
1 
g-——X(t-u 
$—1 j 


4. Remainder: This by the Markoff theorem has expectation 
(r — 1)(s - Dos 
as may be verified easily by noting that it is equal to 
x (yg — E t v Y 
Finally the following distribution theory holds because of Cochran's 
theorem and of the presence of orthogonality: 


1. The remainder surn of squares is distributed as x?c?, regardless of 


whether the b’s and !s are zero. 

2. The sum of squares due to the b’s is distributed as x70" if the b's 
are zero, regardless of the values of the t's. 

3. The sum of squares due to the “'s is distributed as x?c? if the ts 
are zero, regardless of the values of the b’s. 
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In each case x? has the degrees of freedom corresponding to those in 
the analysis of variance table, and the x?'s are independent. If o? 
were known, tests based of x? could be made. This can sometimes be 
done, for example, with data arising by transformation of binomial data 
to angles (Chapter 8). 

If we call the mean squares B, T, and E, it follows that 


1. B/E is distributed as F with (r — 1) and (r — 1)(s — 1) degrees 
of freedom if the b’s are zero. If the b’s are not zero, the value of B/E 
will be larger than would be expected with the b's zero, so that, if the 
observed value is one that will be exceeded by chance in a proportion 
p of times if the b’s were zero, we say that the b’s are significantly dif- 
ferent from zero at the p percentage level. If the value of p is at or 
below the chosen significance level, we reject the hypothesis that the b’s 
are zero. 

2. T/E is distributed as F with (s — 1) and (r — 1)(s — 1) degrees 
of freedom if the ts are zero. We have a similar test and interpreta- 
tion for the /s: i.e., for treatment differences. 


Finally, we note that our test of the ¢’s is not affected by any assump- 
tions about the values of the b's, because of the orthogonality of the 
b’s and s. The variance of any difference of two Î’s is constant and 
equal to 2c?/r. 


6.0 ALTERNATIVE APPROACH TO HYPOTHESES NOT OF 
FULL RANK 


The foregoing approach is satisfactory in most instances but is not 
complete in the sense that it does not indicate exactly what functions 
of the parameters can be estimated. Clearly it is impossible to esti- 
mate u or any bi, say, in the original model. It is preferable then to 
start from the beginning with the linear hypothesis nót of full rank. 
In this section matrix notation will be used. 

We have then the hypothesis 


y=Xp+e (7) 
where 
ui By 111 fg octo Zip [7 
ya Ba 1 21 122 Zap ea 
j= B-|. |. x- and e= 


Yn Bp Tap Taz Inp en 
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The 8's are fixed unknown parameters, and the e;'s are normally and 
independently distributed around zero with a variance of a°. The rank 
of X (the number of linearly independent columns or rows) is supposed 
to be r, where r is less than p. 

Consider the estimation of \’B, where 


M 
à 
* 


Àp 


Suppose we use to estimate \’B, the linear function of the observations 
a'y, where 


an 
Then, if this estimate is to be unbiased, we must have 
X N or Ta A (8) 


We then consider of all the estimates satisfying this condition the one 
that has minimum variance. The error of the estimate is 


a'e 
and the variance of the estimate is 
E(a’ee’a) = (2a*,)o” 


We must find the minimum value of Z^; subject to the condition 
Xa =. Using the method of Lagrange multipliers, we differentiate 
with regard to the a; the quantity 


Z(dà) — 2 2 „( Zyüy — Nj (9) 


ii 


where the p/'s are Lagrange multipliers. This gives the equations, 
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p 
= » pjtij — 0 (10) 
or * f 
a = Xp 
But 
Xa X 

80 : 

X'Xp =X 
or 


Sp = where S = X'X 
If then p is a solution of the equations 
ip = (11) 
the best linear unbiased estimate of A'B is given by 


A 
XB = pXy (12) 
The estimate is the same function of the observations for any solution 


p of the equations Sp = X. For let p; be another solution of the equa- 
tions; then this leads to the estimate 


: O, 
The system of equations in ê 
SÊ = X'y 
is consistent, so that 
piX'y = SB = p'X'y 
The variance of the estimate is 
E(p'X'ee'Xp) = X Xp) 

= e (Sp) 

= op (13) 
This, of course, is constant for all solutions p of Sp = A, for, if Sp; = X 


also, 
p'Sp = p'Spi = p'iSpi 
The general procedure then for the hypothesis not of full rank is to write 
down the equations 
SB = Xy 


If any linear combination of the left-hand sides of the equations, say, 
p SB, is equal to A'Ê, then the estimate of ß is the same linear com- 


ALTERNATIVE APPROACH TO HYPOTHESES NOT OF FULL RANK 77 


bination of the right-hand sides, and the variance of the estimate is 


equal to pA 
With the 2-way classification, 


yy = u + bi t tj t eis i= eer any j=1,2,---,8 


the equations SB = X'y are: 


rsp + sb, + sba +--+ 8b, + rh + rhe +--+ rhe Y.. 
sa + shy + ht htt b=". 
sa + sho ++ 2 , =Y 
ra + byt batet bri -Ya 
ra + by + be e b. rly * F. 2 


% . MEN LT 


1 1 : 
The estimate of f — lz is then (V. 1 — Y.2); and the variance of the 
T 


estimate is 0 
o 


2 


r times c? = — c? 
T 


s—2 times 


r times 
— 1 L ——— 
net (o. b 8 10 70) 1 


(s — 2) times 


0 


Any linear function of the parameters X B, such that there exists a solu- 

tion to the equations 
Sp = 

The condition that these equations have 


may be said to be estimable. 
on that 


a solution is equivalent to the conditi 
E(p'X'y) = MP 
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This states that there exists an estimate for any function of the param- 
eters which is a linear funetion of the expectations of the observations. 
Clearly only such functions can be estimated by linear functions of the 
observations. 

Tt is virtually obvious and may easily be proved that, for the hypothe- 
sis of rank r: 


1. There exist only r linearly independent estimable functions. 

2. Any reparametrization leads to the same estimate of an estimable 
function. - 

3. The best estimate of a linear function of estimable functions is the 
same linear function of the estimates of the estimable functions. 

4. The hypothesis may be expressed as an hypothesis of full rank on 
a set of r linearly independent estimable functions. 

5. It is possible to test hypotheses only about estimable functions. 


Finally we need a definition of orthogonality of estimable functions. 
If M, and Mf are estimable, their estimates are 


À piX'y and p'X'y 
The covariance of these estimates is 
E(p';X'ee'Xp;) = c^ pi Spo 
= o^ (pA13) 
which is zero if p'jÀ; equals zero. Clearly any block comparison is 
orthogonal to any treatment comparison in the 2-way classification 
with equal numbers. 

In addition there are certain invariance properties which hold and 
which enable the analysis of variance to be constructed easily by the 
imposition of linear conditions on the set of equations 

SB = xy 
If f is a solution of these equations, obtained by the imposition of any 
conditions, then B'S is invariant, for, if B; and f, are two solutions, 


BSB, = BSB. = bsp. 


yy = (y — Xf't - Xf)  f'sá 


and y’y is clearly invariant, the quantity (y — XB)’(y — Xf) is invariant 
and is distributed as x?,_,07. Invariance is also obvious from the fact 
that XB is estimable, and therefore XÊ is unique. 

It is possible only to test hypotheses about estimable functions. It 
is not, however, necessary to go through any algebra to obtain the tests, 


Also, since 
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for, from Chapter 5, all we have to do is to find the minimum sum of 
squares of deviations under the various hypotheses, and this leads to 
the usual tests of significance. 
For instance, in the 2-way classification, the hypothesis is Ho, that 
yj = n + bi + tj + ei 1-212, 57 =, 2, 8 


We may test t; — t = 0, for all j # j", since every tj — tj is estimable. 
The minimum sum of squares under Ho is obtained by taking any solu- 
tion of the normal equations derived by imposing linear restrictions on 
the estimates. This gives 


E My- Yi J T . 0 1 
i 


The minimum with the hypothesis under test Hi, say, that 
Yj = Mtoe +t tej 
is likewise obtained to be j 


X Wa- 10 


which equals Q, + Qz. (The notation for Q1, Qs is that of the previous 
chapter.) 
Therefore, 


O = LG 1. 0 
7 


and the F test is 
Q2 


Qi 
lrun 


The most useful part of this exposition is the definition of an estima- 
ble function, its estimate, and the variance of the estimate. These we 
shall have occasion to use in several places throughout this book. 


6.3 THE 2-WAY CLASSIFICATION WITH UNEQUAL 
NUMBERS AND NO INTERACTION 


The model is 
Vijk = u + bi + lj + eii; 12 1,2, =r; j212, 5s (14) 


with the usual assumptions, and the number of observations in the (i) 
cell is n: i.e., the range of k is 0, 1, 2, «++, mj. We shall refer to the i 
classification as blocks and the j classification as treatments. 
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'The normal equations are: 


N..a+ L Nib; + LN = Y... 
i a 
NR + Ni; sis PE nijl; Ft. (15) 
j 
Vn + 25 nii Nl; = Y 


As usual the replacement of a dot for a subscript letter indicates a total 
(capital letter) or a mean (small letter) over the possible values of the 
subscript. To solve these equations, we may determine each (u + b;) 
in terms of observational results and the /;'s, thus: 


1 ^ 
a+b, = —(Yi..— D mif) 
Ni. j 
(16) 
1 ; 
Bb, = — (Vz.. L nal) 
No. j 
and so on. 
Substituting in the ¢ equations, we get the equations, 


nij NijNik 
( = ro) t — Li WI ) =Q; (17) 
where 
F.. 
Q; = F.. — D (18) 


These equations are not independent, it being easily verified that the 
sum of left-hand and of right-hand sides are both identically zero. To 
obtain a unique solution we may impose any condition, the simplest 
one (generally) being Zi, - 0 
A convenient method of solving these equations is to augment the equa- 
uoga Zw, = Q; (17a) 
by introducing another unknown, say, z, and making up the set of 
a Anh + Male K... + Aud +2 = Qi 

Darby + Malz .. 4 Ml, + 2 = Qe 

x 8, S Ye eR CR m t ee eas (19) 

Mh T N. ala A +2 = Qe 

ht 54e h „0 


2-WAY CLASSIFICATION 81 


Denoting the matrix of the coefficients by A, we find the inverse of A, 
say, C, and the solution of the equations is 


n Qi 
12 Q» 
=c]: (20) 
[ Q 
z 0 


As a result of the imposition of the chosen condition, any f; is the esti- 
mate, in fact, of (t — L.). This procedure is useful in that it produces 
as a by-product the variances and covariances of the f's, for the variance 
of ¢; is cao? and the covariance of f and [; is c;jo*. As far as estimation 
is concerned, we now have to obtain estimates of », b; which may be 
done by substitution back into the equations 15 and imposing the con- 
dition, say, that 26; = 0. The reduction in sum of squares due to 
fitting u, bi, and tj is R(u, b, t), which is given by 


R(u, b, ) = BY... + E bY... + LV. 
i j 
'The residual mean square which equals 


bL — Riu, b, J 


IV.. — (r + s - D] Lijk 


is an unbiased estimate of o°. 
We now set up the two hypotheses, 


Ho: yis = u + bit lt eii 
Hy: yk = nc bi + eijk 


and we may omit t in the Hi equation. Under H, the normal equations 
lead to a + b; = yi.. so that the reduction in sum of squares is 


R(u, b E 
(u, b) - Ne 
The reduction in sum of squares due to fitting u, bi, and 6), i.e., under Ho, 


18 2 
Riu, b; t) = RY... + Lb. F.. + XY. 
i J 
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and this equals 
D (a + by. + XY. 
i 7 


=E= Y. TE mid+ The, 


Y i ni 
- Lut Eur. —ExYe) 


2gyYoo t È (ui. - y. „... + E ig. 
= Ri, b) + © bQ; 
4 


For testing treatments then, we have the analysis of variance shown in 
Table 6.2. 


TABLE 6.2 
Mean 
Due to df Sum of Squares Square 
rx 
Fitting u, bi r J Ne 
Fitting tj 8 1 L ta; T 
j 
Error N..—r-—s-cl By subtraction E 
Total about zero N.. Leut 


tyke 


The test of the hypothesis t; = t is made by comparing T/E with the 
appropriate F distribution. 

An alternative form of the analysis of variance which is more fre- 
quently used is the one in Table 6.3. 


TABLE 6.3 
Mean 
Due to df Sum of Squares Square 
Blocks ignoring treatments r-i ME Pe: — Le 
i a 
Treatments eliminating blocks s — 1 ' Sta T 
7 
Error N.. — 71471 By subtraction E 
Yt. 
T N..-1 "Y ees 
a Dra- N. 


The relationship between the two forms is obvious. It should be 
noted that the mean square for blocks ignoring treatments may not be 
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used to test the hypothesis that b; = b, because it will contain treat- 
ment effects. With orthogonality, of course, this is not the case. 


6.31 A Numerical Example 

For the benefit of the less mathematically minded reader, we will 
work through an example with artificial data in full. 

Suppose the data are as shown in Table 6.4, being fleece weight of 


TABLE 6.4 


Type of birth 


Single 


Twin 


sheep. The model is 
yik = H + ait lj ek 


the e;;’s being normally independently distributed around zero with the 
same variance 92. Then: 


ni = 2, ni2 = 2, Ni. = 4 


Ng = 2, Noo = 2, No. = 4 
nı = l, naz = 0, Na. = 1 
na = O, n42 = l, Ny = 1 
N. 1 = 5, N. = 5, N.. = 10 


TE - 15, Yiz. - 13, Vege = 28 
Yoo- = 14, Yai = 31 


< 
E 
[] 
— 
z 
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The normal equations are: 


10p + 4d, + 4% + da + dy + Sl) + 5b = 78 
4p + 44, + 2l, + 22 = 28 
4p + 442 + 2i, + 2h = 31 
â + da +ô =10 
n . ＋ 22 9 
50 +24, + 24 4% J 50% = 42 


5 ＋ 24d ＋ 22 J + dl = 36 


or 


ere ETER 78 
4 4 0: 50-2 | H | 
4 0 0 0 2 2 | dig | | 31 
1270450. 45-0 71-70 | 43 — 110 
1:30:50: 0. YO Eia 9 
s22105 offal [e 
5 2 2 0 1 0 SI LS 36 
Substituting for @ + âi, & + dz, , in the equations, we get: 


15 T = T Tn - 4127 90 01 
G71 7471 5 — 4 -F-E 4% =Q 


where 


FF F,. 
-42—2x238—2 K 31 & 10 - 2x9 
= 42 — 14 — 15.5 — 10 = 42 — 39.5 = 2.5 

Qo = 36-3 X 28 & 31 KX 10 - 1 x9 
= 36 — 14 — 15.5 — 9 = 2.5 


So the ¢ equations are 
2¹¹ * 2i; — 2.5 


-- 2l, + 2i, = — 2.5 


A NUMERICAL EXAMPLE 
The solution in this case is obvious: Imposing the condition, 


1 ＋ 2 = 0 or i = i 


we get 
4t, = 2.5 
or 
ü = 0.625 
So 
A = 0.625 
A = —0.625 


Substituting back in the normal equations, we have: 
4pt+ 441 = 28 or n ＋ 41 = 7 
4 + 442 — 31 or Ata = 7.75 
n ＋ 43 = 9.375 


ft â, = 9.625 1 
Adding, we get 
4p + d, + da + dg + d, = 33.75 


and we then impose the condition 


4. + 4 + dy + 4. = 0 


This gives i 
a = 8.4375 
and then 
41 = —14375 
42 = —0.6875 
dg = 0.9375 
dg = 1.1875 


It follows that 
R(u, a, i) = 8.4375 X 78 + (—14375) X 28 
+ (—0.6875) X 31 + 0.9375 X 10 
4+ 1.1875 X 9 + 0.625 X 42 + (—0.625) X 36 


= 620.375 
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The analysis of variance is then as shown in Table 6.5. 


TABLE 6.5 
Sum of Mean 
Due to df Squares Square 
Fitting constants for u, aj, tj 5 620.375 
Remainder 5 3.625 0.725 
Total 10 624 


The estimate of c? is 0.725. Suppose now we wish to test the hy- 


pothesis: 4 = z. We need to calculate the additional quantity, , ,. 
In this case it equals 


0.625 X 2.5 + (—0.625) X (—2.5) = 8.125 
As a check we may obtain 
.. . 
Ni. No. Nz.. N4. 
= (428 + H31 + H10 + H2? 
= 617.25 


and note that 
1 620.375 — 617.25 — 3.125 


The analysis of variance for testing 4; = tz is then as presented in 
Table 6.6. 


TABLE 6.6 
Sum of Mean 

Due to df Squares Square 
Fitting u and a; 4 617.25 
Difference 1 3.125 3.125 
Fitting u, ai, tj 5 620.375 
Remainder 5 3.625 0.725 : 

Total 10 624.00 


We compare F = 3.125/0.725 with the F distribution with 1 and 5 
degrees of freedom. A test for the hypothesis, a1 = az = dg = à, may 
be made similarly. 
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Finally, to exemplify the calculation of variances we augment the t 
equations to give us three equations: 


9f, — 2h +2 = 25 


—23 + 22 +2 = -25 


i+ 6 =0 
or, in matrix form, 
2 —2 111 2.5 
—2 2. 1 ty =| —2.5 
1 T ONL 0 
The inverse of the matrix, X 
2 —2 
—2 2:1 
1 10 
is 
4:170 
A 
1 4 
EE 8 2 
1 0 
It follows then that tt 
For fi, which, in fact, equals (i a}: j 3 the variance is 140°. 
i, +h 


For la, which, in fact, equals (i — ate, the variance is 10”. 


For (f, — ê), the variance is [14 +1- 2X (-le = Mee". 


— fy) is estimated to be 14(0.725) = 0.362. Our 


The variance of (4 
the difference is 


conclusion on the effect of type of birth is then that 
f, — 2 = 1.25 + 0.60. 


6.4 THE CASE OF PROPORTIONAL FREQUENCIES 


when a randomized block is repli- 
material and three times on an- 
be of a special type: 
or. in words, that the 


In certain situations, for example, 
cated twice on one set of experimenta 
other set, the inequality of the frequencies may 
namely, that the us may be expressed as kr;8j 
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frequencies are proportional. Under these cireumstances we would 
have 
N.. = krjS. where S. Ès 
j 


N.-kR.s; where R. - Dr. 


d 
25 V. = e. S. 


The normal equations 15 then become: 


kR.S. + kS. 7) + KR. b =Y... 
(F rbi) +R (Y sb) 
rid. ze kr SB; + kr; (x sil) = Yi. (15a) 
j 
KR. + ks; (x rbi) + kR N, =Y.. 


Imposition of the conditions, 


2 rbi -0 
LX si; =0 


J 


leads immediately to the solution: 


By... 
b, = ] . — Ye 
i; = yj. =y... 


Orthogonality of the b's and ¢’s now holds, and the analysis is easily 
completed. 


6.5 MORE COMPLEX CLASSIFICATIONS 


We shall deal below with a few other cases of the analysis of multiple 
classification data with unequal numbers. We shall also consider 
models with interaction. These cases do not occur very frequently when 
the experiment is completely under the control of the experimenter, but. 
they do arise, for example, in genetical research. They are important 
for the student of experimental design also in that they provide examples 
of the change in the analysis and interpretation n about by the 
inclusion of an interaction term in the model. 
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6.5.1 The 2-Way Classification with Interaction 
The model that we will assume for this case is 


Yije = B+ a; + ty + hij + eijk (21) 


in which the terms , a;, tj are defined as before, and the term h;; is a 
measure of the interaction contribution to individuals in the (7,7)th cell, 
and % is a deviation or error. Note that, with the non-interaction 
model: 

Vk — Wrjk = à; — a; + error 


Vir — yea = by — tj + error 
and 


Yije — hit — H + Vk 
= (u + aj +t) — (u+ ar +t) — (ud ai ty) 
+ (u + a; + tj) + errors 
= 0 + errors 


In the case of the new model, 
Werk — Yije — Wk + Vie = hey — he; — hip + hij + errors 


so that the effect of a change in the first classification (factor) depends 
on the level of the second classification (factor). 
The estimation of effects and interactions proceeds as in previous 
cases. By assuming that the deviations ef have an expectation of 
zero, have the same variance c?, and are uncorrelated, we may apply 
least squares. It is a simple matter to show that for this case the best 


estimate of the true cell mean, namely, 


u + ai + lj + hij 
is, in fact, 
Li 
Vi- n 
Any function of the true cell means is estimated by the corresponding 
function of the observed cell means. 


90 
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The analysis of variance which provides an estimate of c? is the well- 


known one (Table 6.7). 


TABLE 6.7 
Mean 
Due to df Sum of Squares Square 
vay. 
Mean or correction 1 T 
Y?;. YS. 
Between cells rs — 1 — — 
yg nij N 
Within cells N..—rs X€Ga-w E 
ijk 
Total N.. » Wisk 
ik 


The number of degrees of freedom for “between cells” will be rs — 1 if 


all the cells are occupied by at least 


one individual. Otherwise it is the 


number of occupied cells minus one. The mean square within cells, 
E, say, gives an unbiased estimate of a°, The variance of an observed 


cell mean is 


c? 


nij 


which is estimated by E/n;;. The 


variance of any linear function of 


the cell means may be obtained easily and, hence, the variance of any 


function of the parameters that can 


, in fact, be estimated. 


As in all cases of a linear model, we test a hypothesis by obtaining the 


minimum sum of squares under the 
the hypothesis to be tested. The 
hypothesis under test is R(u, a, t). 


original hypothesis, and also under 
sum of squares removed with the 


We may then make up the subdivision of the analysis of variance 


shown in Table 6.8. 


TABLE 6.8 
Mean 
Due to df re Sum of Squares Square 
Fitting u, aj, t 115 —1 R(u, a, t) 
Difference re—r—s+1 Difference I 
Fitting u, an t, and 
interaction rs " 
Within cells . "t Freview table „ 
Total N.. 


E vie 
7 
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The test of zero interaction is to compare I/ E with the F distribution 
with appropriate degrees of freedom. 

Now to consider hypotheses about effects. It is necessary for us to 
be more specific about what we mean by effects when there are interac- 
tions than when there are not. When we wish to test the effects of the 
i classification, we must specify over what set of conditions given by the 
j classification we wish to consider this effect. "We noted previously 
that the functions that could be estimated are the true cell means and, 
hence, any function of these true cell means. So we can consider the 
effects of the 7 classification averaged over the set of conditions given 
by the j classification, assuming these conditions occur equally fre- 
quently, or alternatively as they occurred in our data, or again accord- 
ing to some preassigned frequencies. There appear to be no difficulties 
once the set of conditions has been specified. In the presence of inter- 
action, the existence of cells with no observations prevents the estima- 
tion of effects without further assumptions. 


6.5.2 The General p-Way Classification without Interaction 


In this case each individual is classified in » different ways, say, ac- 
cording to age, breed, year, sire, dam, and so on, if the observation unit 
is a cow, for example. We are assuming that there are no interactions, 
so that the model can be written 


kt... = BA a; + b; + e did ege (22) 


Here the effect of a change in position with regard to one classification 
is assumed to be the same, regardless of the position of the individual 
with respect to the other classifications. The contributions in the model 
have an interpretation similar to that for the 2-way classification. 
Again assuming that the e;;j;'s have an expectation of zero, have the 
same variance c?, and are uncorrelated, we may use least squares. 
With regard to notation we adopt the following rules: The last of the 
(p + 1) subscripts on the symbol tte, will denote the order number 
of the individual in the cell given by (7, j, k, +++). The number of in- 
dividuals in this cell will be denoted by 7;j;..., there being p subscripts. 
Sums over all the groups of a classification will be denoted by capital 
letters with the subscript for the classifications over which addition is 
performed replaced by a dot. Thus with a 4-way classification, we shall 
have % in, and m is the order number of the individual in the (ijkl) 
class, there being njje individuals in this cell: the quantity F.. x., for 
example, is equal to 2 Wükim. The normal equations will be as follows + 
jám 
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for the case of a 3-way classification with i = 1,2, ---,7; j = 1,2, => 


k = 1, 2, ---, t, only typical equations being given: 
Equation for: 


nu V. a- NVI. . 41 Te V.. Op -V. 1. bi ENG, 
＋ V. 161 NV. . et EY... 
ay VI. A Ni. Nui Nn ++ VII. b. 
TNiaGc VI VI. 
a Ns +No..d2 ENaubi- Nub E.. Va.. b. 
[ ＋ Vz. ie K.. EVA. . V2. 


by V. I. A VII- A1 Nnded . . VI. 4, Nai 


23) 


NV. eV. 1262 d N. 106 = Y as 


be N.N adi L Var. d: EN paid LN. a. ba 


+N ati tN bt N. 261 = V. 2. 


a N. 14 T MI. 141 Vz. 42 . . . Vr. 14, +N nb: +N ab +N sibs 


+N..16, =Y.. 


ca N. 2g Nada f Ma. 242 f. . Vr. 24, . V. 151 +N obat +++ N. 2b. 


b 


+N. . 262 F. 2. 


A procedure we may follow for solving the equations is the following. 
Let us suppose that r is greater than s or t. Then we may solve the a 
equations for (A + 4;) in terms of the bs and é’s. These expressions 
may be substituted in the b and c equations to give equations only in 
the 6’s and é’s. These equations can then, if desired, be reduced further 
by solving for the b's in terms of the é’s, and so on. Thus, for the 


above equations, 
1 
f ＋ d = D — > Nb; = » Nó êk) 
Lee j k 


1 
f ＋ 42 NIMM — L NI, b, =! L Naa6) 
An 7 7 


etc. So, substituting in the b; equation, we get 


(vs xS pay 
ax SG = ed -2Y;j.— ri Y, 


j- E3:,4 


(24) 
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Similarly, the equation for e becomes, on substitution for (à + 4j) in 
terms of the 6’s and é's, 


— (Vn E —.— b; (N-a z Ere 6k 


i Ni. 7 Vi 


Ni. Ni. „ Ni. 
(Tha r LN 7. e» 


k= 1 2 5t 


By substituting in this fashion, we retain the symmetry present in the 
original equations: namely, that the coefficient of & in the b; equation 
is equal to the coefficient of 6; in the e equation. 

The next step could be done in the following way: 

Consider the matrix of the coefficients of the b’s in the b equations, 
namely: 


Na Na Nie Nei- Mis 
. s zn 
Niz Nil. N?i Nis Nis 
D N. EET Ly 
Ns 


Let us augment this matrix A — (^99), say, p. d = 1, 2, „ 8, by adding 
a column of l's and a row of l's except for the (s + 1, s + 1)th ele- 
ment which is zero. Suppose this gives A’, which is then 


N?a Na-Nis 
Pat, ee Bo ee! 1 
va — Ni.. 2 Ni: 
Ni.Nà. Ni Ni, 
E — 1 
— Ni: x Ni 
A= 
Na Ni- N is 
rid aabt LI a 1 
ji — N.. H 7 Ni 
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Let the inverse of this matrix which will be symmetrical be D, where ; 


du ets | oN an 
doy hp ating d», do, 
Dis ds AD Coe ais (26) 
ida . 
d. in E i d. 41,8 d 141 
Then 
Ng. 
51 didi c5 dis Dim coed V.... D fut 
be i Nj 7 
il. : 2 (27) 


: Na. 
b, diui dalbYus—3-——— Yee DoS itt 
2 NS k 


where f, is the matrix of coefficients of the cs in the b equations. We 
may then substitute for the 6’s in terms of the &'s and known quantities 
in the equations for the é’s, thus obtaining a set of t equations in the é’s. 
These again may be solved by adding a row and a column of 1's except 
for the lowest diagonal element which is zero, giving, say, a matrix G. 
This matrix may be inverted to give, say, hu», u, v = 1,2, -+:,¢+1, 
and the estimates obtained in the usual way. The variance-covariance 
matrix of the é,’s is : 
(uv) 


The other parameters may then be estimated by substitution. 
The sum of squares attributable to u, a;, bj, cy is R(u, a, b, c) equal to 
RF. . . + Z&Y;... + Th, V. . + Ter F. 
that is, the sum of products of the estimates and the right-hand sides 
of the normal equations. 
'The analysis of variance is then as shown in Table 6.9. 


TABLE 6.9 
Mean 
Due to df Sum of Squares Square 
Fitting constants for 
u, Qi, bj, Ck r+s+t-—2 R(u, a, b, c) 
Remainder r N..-r-s-t-42 By subtraction E 


Total N... à Vn 


' 
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The mean square Æ is an unbiased estimate of o°. Any estimate has 
an estimated variance obtained by replacing c? in its true variance by E. 

Suppose we wish to test the hypothesis that the c's are equal. We 
must assume as before that the e;;,/’s are normally distributed, in addi- 
tion to the previous assumptions. We fit the model in which the c's 
are replaced by a constant c (or put equal to zero). Thus, we fit the 
model 

Wiki = u + aid bj + eia 


and obtain the sum of squares due to fitting constants for , aj, and bj, 
say, Ic (u, a, b). 
The analysis of variance is then as given in Table 6.10. 


"TABLE 6.10 


Mean 
Due to df Sum of Squares Square 
Fitting u, ai, bj r+s-1 R(n, a, b) 

Difference 323 By subtraction C 
Fitting u, ai, bj, cx r+s+t-2 R(x, a, b, c) 
Remainder N.. —r—s—-—t4+2 By subtraction E 

Total NL Dd yn 

ijkl 


The ratio C/E is compared with the F distribution with appropriate 
degrees of freedom. If the procedure given above for eliminating u. 
ah, and b; from the c equations is followed and the right-hand sides of 
the resulting c equations are called Qi, ++% Qa, the sum of squares due 


to “difference” above is TC. N tr 
Tests for the following hypotheses may be obtained in a similar way : 


a; — a, b; — b, cx C 
a; = a, bj =b 

a; = Q, Ck 7€ 

bj = b, c * =e Y 
d. = d 

bj = b 


It is unfortunate that the computations for these tests have little in 
common, so that one has almost to start from scratch with each hypoth- 


- esis to be tested. 
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Tests for hypotheses such as b; = b», without specifying the other b's 
may be obtained by the same process: i.e., obtaining the difference in 
sum of squares due to fitting the full model and the sum of squares due 
to fitting the adjusted model. The mean square of the difference is 
tested against E by the F test. 


6.5.3 The Case of Missing Observations in Planned n-Way 
Classifications 

In the ease of the n-way classification for which the experimental 
plan called for one observation per cell, it will occasionally happen that. 
the observations for a few cells are missing. In this case some special 
devices are available. We shall discuss the 2-way classification: e.g., 
bloeks and treatments for illustrative purposes. 

The treatment of a 2-way classification without interaction with 
single observations per cell except for some cells with missing observa- 
tions is a simple case of the 2-way classification without interaction 
and with unequal numbers, for we take n;; = 0 for the cells in which 
observations are missing and n;; = 1 for the cells with an observation. 
This method is quite general providing, of course, that no classification 
is missing entirely, in which case the model and normal equations must 
be revised. If several observations are missing, the procedure given for 
solving a set of equations for the ts is best. Alternatively, if the num- 
ber of block parameters is less than the number of treatment para- 
meters, an analogous set of equations for the block parameters may 
be obtained and solved and then the treatment parameters estimated 
by substitution of these estimates in the treatment equations. It is 
necessary to assume that the missing observations do not arise as the 
result of factors whose effects we wish to estimate. 


6.5.4 The Alternative Method of Analyzing Incomplete Experiments 
When only a few observations are missing, a simple method of esti- 
mating the ¢,’s is available, providing that all treatments and blocks are 
represented. We insert algebraic symbols x, y, ete., for the missing ob- 
servations and perform the usual analysis of variance, supposing that 
T, y, etc., are numbers. The remainder or error sum of squares may be 
evaluated, and it will be a function of z, y, etc., and their squares and 
products. Estimates of x, y, ete., are obtained by minimizing this sum 
of squares with regard to x, y, ete. The estimates of x, y, etc., obtained 
are inserted in the,2-way table and the marginal means calculated. 
The deviation of the ith treatment mean from the general mean of this 
augmented table is then equal to i; Furthermore, the remainder sum 
of squares in the correct analysis of variance for the data as actually 
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obtained is equal to the remainder sum of squares in the analysis of 
variance of the augmented table. It is then a simple matter to caleu- 
late the total sum of squares of the original observations, the sums of 
squares due to the mean, and to blocks after taking account of the mean, 
and thus complete the analysis of variance in the following way, k being 
the number of missing plots (Table 6.11). 


TaBLE 6.11. Exact TEST oF SIGNIFICANCE FOR TREATMENT DIFFERENCES 


Due to df Sum of Squares Mean Square 

(block total)? 

Mean and blocks r B= . 
no. in block 

Treatments s-1 T — E — B (obtain by difference) 

Mean, blocks, 

and treatments r+a-1 T — E (obtain by difference) 
Remainder * — 96 ) — * E (obtain from analysis of 


augmented data) 


Total ra—k T = Xy; (summing over actual ' 
observations only) 


'The order of computation is: 


1. Obtain T. 

2. Obtain Æ. 

3. Obtain T — E. 

4. Obtain B. 

5. Obtain T — E — B. 


An approximate test of significance is obtainable from the analyses 
of the augmented values by treating the augmented table as the actual 
yields except that the degrees of freedom for the remainder are reduced 
by the number of missing observations. It can be verified that the 
treatment mean square has an expectation of the form kyo*+ ro”, 
where k, is greater than unity. It is this latter fact that results in the 
bias of this test. Furthermore, the treatment sum of squares so ob- 
tained is not distributed as x20? under the null hypothesis that the ¢;’s 
are zero, nor is it distributed independently of the error sum of squares. 
The approximate test may be obtained quickly and suggests when it is 
desirable to calculate the exact significance level, since the significance 
level indicated by the approximate test is, in general, too large (i.e., 
instead of, say, 10 percent, the test may indicate a 5 percent level of 
significance). 

As a method of estimation of treatment effects and block effects, the 
substitution of algebraic values js generally the simpler operationally, 
but the matter depends on the number of missing plots. For example, 
in an experiment with 20 blocks of 4 treatments with, say, more than 
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5 missing plots, it is simpler to solve the normal equations for the 4- 
treatment parameters, £j, t2, ls, and t4. 


6.5.5 Proof of Alternative Procedure for Missing Plots 


Algebraically the alternative procedure consists of performing the 
analysis of variance on the model 


Vij = p + bi + tj + eij for plots present 
and 
tij = u+ b tj 


if the observation in the (, j)th cell is missing and we substitute zj; 
forit. The estimation procedure is to minimize the error sum of squares 
over the z;;'s. The error sum of squares is the minimum of 


Z(wj— u — bi % ZG u — bi — t)? 


Taking the minimum of this sum of squares with respect to u, bi, tj, 
and . is obviously equivalent to taking the minimum of 


2 % — e — 0; = 0 


where summation is over cells for which observations are present, be- 
cause the minimization over the z;; gives merely 


4% = n b. 4 f, 


This then identifies the procedure of Section 6.5.4 with the general pro- 
cedure. Clearly the best estimates of differences amongst the bes or 
the /j's are given by, the corresponding differences of the marginal means 
of the augmented table. 


6.6 THE ANALYSIS OF COVARIANCE 


The analysis of covariance may be incorporated simply in the least 
squares approach given in this and the previous chapter. Consider the 
2-way classification with one observation per cell and no interaction. 
Suppose we have also an attribute x subject to variation over the ex- 
perimental area or units. In the absence of treatment effects, we might 
set up the hypothesis 


yi = n + bi + Brig — &) + ei; 121,2, % 


j = 1,2, -:-,8 
and wish to test with the model 


% = n bi + BG — DAG + eij (28) 
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whether the /s could be equal. It is convenient to measure the æõ 08 
about their mean r. We suppose, as before, that Eb; = 0, as we have 
an arbitrary choice at our disposal. We wish to have an analysis of 
' variance of the form shown in Table 6.12. 


TaBLe 6.12 4 
Due to df Sum of Squares Mean Square 

u, bi, and 8 r+1 R(u, bi, B) 
Treatments after p, 

bi, and 8 s—1 Difference 
u, bi, B, and tj rtlts-l R(u, bi, B, t5) 
Residual rs = Difference 

Total rs Zy'ü 


Our equations for estimating «(= u + 1), bj, 8 when we ignore treat- 
ments (i.e., assuming the /;'s are equal to t), which estimates we denote 
by g, b; and 8, are, using the conditions, 2b; = 0: 


rsp L9 4 
si + sb; + B 2 (tj — | = Y. (29) 
j 


x S (* — a $ )[z (rij — 5 = iue — *) 


j 


It follows that 


ü E 
sb; +8 TLC 2) = (Yi V. em 
or i 1 B 
b; = -(Y;.— V. /r) „ 
E] 8 j 
so 


If. -C- „C 
8 8 j i ij 
= Liles — © 
10 


1 J 


and ; 
ize -»-:x[xe-o]| 
= Xy 1) — "» [:(v. - — — (rg — | (31) 
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Similarly, with the model 

yj = u + bi + Brig — 2) + G + eij 
the equations are, using the conditions, Zb; = 0, Zí; = 0: 
rsă =F.. 


sa + sbi + 8 È (zi — 3) = Y;. 
{ (32) 


rh + rl; + BD (n — 2) 


zs 5. r Èi; 2; (rij — * 
t J J t 
+ê b» (n;— 2)? 


Yj 


Dune, — 2) 
ü 

where we use the circumflex (^) to differentiate these estimates from 

the previous ones. It will be found that 

EET 
"nme 


9 (ey — 2? Seppe (ss - 2| 


ORTA, SERE ON TES Ih ch 
-xX[|w--L.—][s-T--44 | (33) 


T 78 


[x (ng — Zi 


i 


and that 
HELD CE m — 2) (34) 


To bring these formulas into the form of the analysis of covariance, 
suppose that analyses of variance on y and x and án analysis of the 
products yx are performed to give the information in Table 6.13. 


TABLE 6.13 

Due to y: zy zi 

2 
Mean y.. eg X5. 

rs rs rs 

b's By Byz Bzz 
t's Tw Tyz Tz 
Remainder Ew Eys Ex: 


Total Ery Lua Ley 
9 7 7 
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The symbols are as follows: 


X.. = pier 
ij 


1 rt. 
By = = 52; pub hg ae 
8 rs 
1 M neo, oe 
B.., FN 
8 rs 
1 x26 
B, NX. 
8 rs 
T lyy? 
Mory TS 
N 
Ty: = ZF. X. z 
1 oE 
Ter = 2 —— 
T TS 


E,,, Eis, and Ez, being obtained by subtraction. With the above no- 


tation, 
Ty, + Ey. 


g Tzz A Ezz 
Es 
Ez 


B 


and 


For the fitting of g, bi and B, we can obtain with some algebraic manip- 
ulation the breakdown of sum of squares-(Table 6.14). 


Tasti 6.14 
Due to df Sum of Squares Mean Square 
fi, bi, and B r+1 Difference Di 
(Ty, + Eya)? 
Remainder re—r—1 Tw + Ew — aoe 


EE 


Total rs Zy'ü 
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For the fitting of a, 5% Ê, and £j, we can obtain the breakdown of the 
sum of squares (Table 6.15). 


TABLE 6.15 
Due to i df Sum of Squares Mean Square 
A, bi, 8, lj r+s Difference Ds 
E? a 
Remainder s s Ey — — 
Total rs Eyy 


For the null hypothesis that the Js are zero, we may test the mean 
square 


1 

se = Da) 

18 Yol (T, + Eya)? EA] 
= || tw + By) - Se" | - (n, - 75) 


Jos + Ezz 
against the mean square 


1 =e) 
E gg us 
rs — 1 — -( d Ezz 


by the F distribution with (s — 1) and (rs — r — s) degrees of freedom. 
It should be noted that we no longer have orthogonality of the bs 
and %s and that f is not orthogonal to the £s. That the test of sig- 
nificance of the hypothesis ( = t is valid follows from the general linear 
hypothesis theory given earlier. 
The estimates of the ¢;’s are 


EE. x 


r rs r T8 


Any treatment difference is estimated by 


1 
1 zE — Ya) X- X hl 


and has a variance of 


Lm o? * 1 
Pr PE, A.) 


Thus, every treatment difference has a different variance. For pur- 
poses of presentation, it is often satisfactory to attach to each mean ad- 
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justed by the regression a variance equal to half the average variance 


for a difference of 
92 (: F 1 =) Q5) 
s—1Ez 


where c? is estimated by 
1 EV 
— — (i, - S^ 
T8 — ra Ezz 


6.7 COMPONENTS OF VARIANCE 


The analysis of variance by which effects in the multiple classification 
‘are tested is of identical form with the analysis of varianée used for an 
analogous problem of sampling. We need to consider this matter be- 
cause it will arise in connection with certain types of experiment. 

Suppose for example that we have an infinite population which may 
be classified in two ways and that we have one observation in each cell. 
The observation in the (i, j)th cell is assumed to be 

yg = BED + tj ei 1212, „ 7; = 1, 2, „8 
where the e;'s are distributed with common variance o”, the bs with 
variance 2% and the £j's with variance 02% and where the ¢;;’s, bis, tj's 
are uncorrelated, and have zero means. (In some sampling problems 
these have a mean of zero by definition.) 

The analysis of variance may be used to estimate , o°» and o°; by 
equating observed mean squares to expected mean squares as indicated 
in Table 6.16. 


"TABLE 6.16 
Expectation 
of Mean 
Due to df Sum of Squares Square 
Yi. Yt. ; D 
b's r—1 Ze E a? + 8050 
y, Y. M 
t's s—1 r—- e. o + re^, 
Residual (r — 1)(s — 1) Difference o 
y*.. 
Total rs—1 Ivy- Ze 


The important point to note is that it is not necessary to make any 
assumptions about the distributions of the e;j's, b/'s, 4/8 except that 
they are uncorrelated. To make tests of significance of differences of 
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c^, and o°, from zero, however, normal independent distributions of 
the e;;’s are necessary. 

In the general problem of the estimation of components of variance 
there are essentially two cases: 


1. The hierarchal classification. 
2. The multiple classification of the type we have been discussing in 
the early part of the present chapter. 


We shall give a brief discussion of these cases and leave a mixture of 
the two cases for the reader to examine, except for a few cases of im- 
portance to.experimental design. 


6.7.1 The Hierarchal Classification 


The simplest case is that of a 1-fold classification: say, individuals by 
families or observations by individual. The model used is the following: 


yü = n ai ei; 11, 2, % 7 


that is, that the observation for the ith individual in the ith group is 
made up of a portion u common to all observations, a contribution a; 
common to all individuals of the ¿th group, and a deviation e;; particular 
to the jth individual of the ith group. By definition then, the expec- 
tation of any e,; is zero. We assume that the e;j's have the same vari- 
ance c? and are uncorrelated. Suppose also that the a;'s are a random 
sample from a population with variance o. Let the number in the 
ith group be n; We may then obtain estimates of u, a; as if they were 
fixed effeets and construct the analysis of variance (Table 6.17), where 


1 Zn?j 
k= (x. — A.) 
711 N. 
TABLE 6.17 
Mean Expectation of 
Due to df Sum of Squares Square Mean Square 
ss y. 
Fitting u 1 NT 
Difference r-1 Difference A e? + ke? 
Y4. 
Fitting u, a, r — 
+ . 
Remainder N.-r By subtraction * E ei 
Total N. 9 5 ** 
9 


* Equals sum of squares within groups. 
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The expectation of the sum of squares denoted by “difference” above 
is, in fact, the expectation of the sum of squares between families: i.e., of 


DIES 


Now, 
yi = u + ai + ei. 
Mna; 
= : a 
y ut N. an 
8 
2 D nai 
E 75 +e. — 
N. — ni ni 
15 . ES 
1 
(V) D Eh opu? 
Ni A j N. æi j 


The expectation of the square of (y; — .) is then 


N.— ni a n^ ` (N. 4 nj)? (N. =- nj) 
0 N. ) F E Tus [^ Ni W * 


Multiplying by n; and adding over 7, we get 


zw, (Znj) (x 50 m N . 
INT + 2t EJ a + : N. [4 


E 
- (. 2 Ta. + (r= De? 


Dividing by (r — 1) we find that the mean square has expectation 


2; 
0 + (v. V) + hot (36) 
1 — 1 ; N. 
As unbiased estimates of c? and o, we may then use 
=E 


1 
m TE E Ke 
ey 74 ) 
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In general, we shall also wish to have sampling errors of these estimates. 
The variance of these estimates may be obtained exactly in terms of 
the cumulants of thé true parent populations. See for instance Ken- 
dall. 

For example, if the ¢,;’s are independent, the variance of à? is 


1 
N.—r4-Z— 
" ni K’: 
Kk. +2 
(V. — r}? (N. — r) 
where Ko, K4 are, respectively, the second and fourth cumulant of the 
distribution of the e;;’s. The formula for the variance of ó?, is more 
difficult to obtain, though the difficulty is entirely one of algebra, 
If we make the assumptions that e;; and a; are normally distributed, 


then 
4 


var (62) = 2 


n=l 
and may be estimated unbiasedly by 
(6)? 
n+l 


2 


where n — 1 is the number of degrees of freedom for the remainder. 
If the n;;’s are all equal to k, say (so that k above equals this k), 


^ 2 4 72% 
var (c? m ko?,) — 2 . 

1 — 1 
Furthermore, é? and (c? + kc?,) are independent, so that 

var [(c? + kc?,) — 67] = var (c? + ko?) + var (6?) 

(c? + ko*,)? o! 
— +2 

r-1 n—1 


or 


I? var (d?a) = 2 


As an example of the use of these formulas, let us suppose that we 
are dealing, in fact, with material for which c? = 1.0 and o°, = 1.0. 
Then, 

2 
var (4?) = —— 
"?-—1 
and 
(1 +k)? 2 


K? var (67,) = 2 
—1 n — 1 
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Let 
* B, 1 = 10 
then 
n — 1 = r(k — 1) = 40 
and 
2 
var (62) = ij SE (67) = 0.22 
and 1 
1/2x960 2 
ated) 
var 6's) = aaNet ag 
= 0.32 
so that 


SE(é2.) = 0.55 


It is clear that the number of observations given by k and r is completely 
inadequate for this situation. í 

In the case of unequal numbers, corresponding results can be obtained 
after a lot of simple but laborious algebra. $ 


6.7.2 The n-Fold Hierarchal Classification 

We shall deal first with the case of equal numbers and suppose that 
we have groups A (a' in all), groups B (b for each A group) within A, 
groups C (c for each B group) within groups B, and so on. We use the 
model 


Vik = n + ai + bij + ek n eges 


where 
Eleix ) = 0, E(a;) = 0, E (bij) = 0, ete., 


Ela?) = 074, Ebi) = c^, etc. 


and all the terms are uncorrelated. This leads to the analysis of vari- 
ance (Table 6.18) with groups A, B, C, D, and e individuals per ulti- 
mate D group. 


TasLE 6.18 
Mean 
df Square Expectation of Mean Square 
Between A groups a-1 A ot + tolg + dest, + edea? + bedeo*s 
Between B groups within A groups alb — 1) B “ + —1 * desse + edeo’ 
Between C groups within B groups able — 1) c F + i + dea”: 
Between D groups within C groups abe(d — 1) D o + ed 
Error abed(¢ — 1) E L4 
— 


Total (about mean) abede — 1 


108 THE ANALYSIS OF MULTIPLE CLASSIFICATIONS 


The sums of squares are easily obtained. The estimates of the com- 
ponents of variance are given by the linear functions of the mean squares 
the expectation of which is equal to the desired component. If the 
residuals, the a;'s, the b,;’s, etc., are normally and independently dis- 
tributed, the mean squares are independently distributed. The vari- 
ance of each mean square is equal to i 


1 (expectation of mean square)? 


degrees of freedom 


and these variances may be combined in the usual way to obtain the 
variance of a linear function. 

In the case of unequal numbers the situation is more complex. The 
analysis of variance has the same formal.strueture as before, the de- 
grees of freedom depending on the number of individuals in each ulti- 
mate group. It is possibly best obtained in a step-wise manner: Ob- 
tain the sum of squares within the ultimate groups, which is used as 
computed, then obtain the sum of squares within the penultimate 
groups, and obtain the sum of squares between ultimate groups by sub- 
tracting the former from the latter, and so on. 

We shall take a 2-fold hierarchal classification as an example, the 
model being 

Vat = u + a; + bij + eijk 
with 


LOS 


E I CEA 
j71,2, ts Bg 
k= 1, 2, „ 1 


The sums of squares are: . 
Within B groups: L (yije — yij-)? with df TL (ny — 1) 
. ijk ij 
Between B groups within A groups: 
2 niy(yij: — Yi--)? with df L (8; — 1) 
ïj 1 
Between 4 groups: > N.. (I.. — y...)? with df (a — 1) 


The expectation of the within B groups sum of squares is easily verified 
to be equal to 


[= (nij = D] 02 
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By an argument identical to that for the 1-fold classification, the ex- 
pectation of the sum of squares between B groups is 


2 ni 
[x (8; — »| 02 + 175 — * )o. 

The sum of squares between the A groups may be written 
52. yi 
z( N;. ) Reus 

ik = u + ai + bij + eijk 
Yi. = niji + na + nibi + Me 

k 


Now, 


F.. = Nin Nia; + D nifi + D eijk 
j -jk 


. E(Y?;..) = Ver + Nel 2 + 15 my) o^, + Vi. 02 
Also A 
Y... = N.u + EN,;.a; + € nijbi; + MX ei 
ij ijk 
zd E(Y4 = N? + (ZN? ;.)o70 + ( 16 as 4- V. 02 
ij 


The expectation of the sum of squares between A groups is then 


, iw 
^» bod + Nia + ( FT Jaa + " 


o D ni 
N.. N 2 d 2 2 
— wu? +( ote + 7 ato 


N. 


which equals 


D Ve XM. 
p Dah Ix 27; 3 x Je. c^. 


This must be divided by (æ — 1) to give the expectation of the mean 


square. tae 
This process may be extended indefinitely with little difficulty. We 


have then dealt with the case of hierarchal classifications. Aspects 
that we have not considered are: 
1. The variances of the estimates of components: This will proceed 
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in the usual way by virtue of the fact that the estimates are always 
quadratic functions of the observations. 

2. The effect of inadequacies in the model: For instance, the variance 
of the e;;;^s may change from one class to another. Again it is a matter 
of algebra, though somewhat tedious, to evaluate the expectations un- 
der some other model. It should be noted that the model includes not 
only the linear equation 


Vik = M+ ai + bij + ete. 
but also the statement of distributional properties of the quantities on 
the right-hand side of the equation. 


These problems are virtually unsolved at the present time, though the 
procedure to be followed is simple. It is to be hoped that some prog- 
ress will be made on them. ` 


6.7.3 The Case of n-Way Classifications 

The situation now becomes very complex. In fact there appears to 
be practically no theory at all on which to base the estimation in the 
general non-orthogonal case. As a beginning let us state the results 
for the orthogonal ease: namely, when an equal number of observations, 
say, n, occurs in each cell of the classification. 

Suppose that we have the model: 


Va = B+ ti + dy + Ck e 


1 * l, 2, 
21, 2, „8 
k21,2, «t 
l= 1, 2, %% n 


With equal frequencies we obtain a simple procedure by the analysis 
of variance (Table 6.19). 
Tanie 6.10 


Expectation of 


Due to df Sum of Squares Mean Square 
E56 
Me 8 
lean p 1 N 
Differences amonga; or 1 S(a) o? + nsta*, 
Differences among bj — *— 1 SQ) e? + nrta*, 
Differences among c t-1 Sie) a? + nrse?, 
Remamder N.-—r-s-—i*2 By subtraction 


'Total N. (~ nrst) > Va 
oit 
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Estimates of 074, 075, etc., may be obtained from the mean squares 
by equating observed and expected mean squares, and the estimated 
variances of the estimates are now given exactly, if normality holds, 
by the fact that 

Y (true mean square)? 
var (mean square d 1 
The estimated variance of the estimate is obtained by substituting the 
observed mean square for the true mean square, and a divisor equal to 
(degrees of freedom + 2). The true variances may be combined in 
the usual manner for the variance of a linear function. It should be 
noted that the combination of estimated variances raises some difficult 
problems, analogous to the Behrens-Fisher problem. 

In a similar fashion one can write down the analysis of variance for 
the n-way classifieation with all possible interactions included: that is, 
for the model, ; 


Vijkt = w+ a; + bj (ab) + ex + (ac + (be) jx + (abe) r + eiu 
t=], +++, 7; jum 1, o8; kx te 021,5, 


everything except u having expectation zero, variances of the a;'s equal 
to c?,, ete., of the (ab);;s equal to o"a», ete., and all these random varia- 
bles being uncorrelated (Table 6.20). i 


TABLE 6.20 
Due to df Expectation of Mean Square 
1 
a r-1 c? + norare K tee + n + nsto?; 
b s-1 e? + nerabe + nee + nro% + nrto*, 
(ab; -1 -1 o? + no*obe + nto? 
1 í A 1 3 a? + norae + 80270 + robe + nrso*, 
(ac) (r - (t — 1) a? + norabe + ue T 
(be) (s — 1)(t — 1) a? + noabe + nrodbe á T0000 Tip, 
(abc) (r — D(s.— 0 — 1) a? + no’abe A a 
Remainder ran — 1) a S 
— / ^ 
Total nrst E | d) 72 
M 9 % 
These expectations should be verified by the reader. The estimation 9 RJ 
of the components is again straightforward. A vz / 397 


In the case of unequal frequencies, we can regard tlie terms in the a7 
model apart from the error term as being unknown constants and make, - 
up the analysis of variance described earlier in this chapter. If we 
could obtain the expectation of the mean squares in terms of variance 
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components, the “constants” now being random variables, we could es- 
timate the components by equating observed mean squares to expected 
mean squares and solving the resulting equations, which will be linear 
in the components. 

As an example we will consider the 2-way classification with no in- 
teractions. In that ease we make the analysis of variance, in which 
items obtained by subtraction are marked + (Table 6.21). 


TABLE 6.21 
` Sum of Mean 
Due to df Squares Square 
1 Lela) 
Difference r—1 + A 
u and aj T Ri(u, a) 
Difference s-1 + DB 
n, ài, bj 3 R(u, a, b) 
Remainder N..—r-—s-41 + E 
Total N., ur 
ijk 
The expectation: 
Of E is e? 
Of B is e? s EE 1. o, = ot he 
Of A is c? + koc? + kao? 
where ar 
i n? 17 d 
„ (DE-A 
121 j N.. -E N.. 


í XN. 
ka ni : ) 
r-1 N.. 


So, to estimate o°, % and o, we could solve the equations: 
E=% 
B = o da), 
A = 4? + kads + 13625 


More complex cases have possibly been worked out, but the author 
has not found such in the literature. 
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Problems yet to be solved are: 


1. The variance of estimates obtained in this way. 

2. The efficiency of various estimation procedures: We should con- 
sider the estimation by obtaining sums of squares for each classification, 
which will not be orthogonal to each other, and equating observed values 
to expectations. 


6.8 AN EXAMPLE OF THE ESTIMATION OF COMPONENTS 
OF VARIANCE IN A GENETIC PROBLEM 


We conclude with a less common problem in the estimation of com- 
ponents of variance as an example of method. Suppose that we have 
a set of p inbred lines and make all possible crosses among these lines, 
using each as a male and a female parent. It is reasonable from some 
genetie points of view to assume the model 


Yak = nc gi + gi + Sij + Tij uk 
where ' 


Vir = the observation of the kth offspring of line i as male and line 7 
as female parent 
u = a contribution common to all observations 
gi = a contribution particular to line 7 
si; = a contribution particular to the cross of line 7 and line j, such 
that sji = Sij ; ; 
rij = a contribution arising from the difference between using line 7 
as male and line j as a female parent rather than vice-versa, and 
is such that r;; = — fji 
e = a random deviation 


It is assumed that we are dealing with a sample of lines from a popula- 
tion and that the e;;,’s are uncorrelated, with mean zero and constant 
2 The terms gi, Sij, rij are assumed to be random variables 


variance o*. 
with mean zero and variance c?,, «^, and o°, respectively. The aim 


is to estimate 2, c?,, «?,, and 7. We assume also that there are n 
offspring from each possible cross. 

Our estimation procedure will be to regard the g;’s, 5;;'s, and rs as 
fixed variables and construct an analysis of variance. We shall then 
take expectations of mean squares in this analysis and equate them to 
the observed values. The estimates of u, g1; 92, ***» Sij Tij Are obtained 
by minimizing the suní of squares: 


Z(ygk u — 96 — 9j — 94 — rij)? 
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The equations are: 


p(p — Dna  2(p — )n 326; 2n D $i be tae! Mir: 
: ie 
2(p — Dua + 2(p — 1)ng; + 2n L Oy + 2n L = Yi. Y 4 
11 i j 
jd 


I 
ES 
+ 
X 


2np + 2nói T 2n; + 2n$;; 
2nfi Fi. Fi: 
To obtain a solution, we impose the conditions, 


Lo. = 0, Len = 0 foreach i 
i j 


The solutions to these equations are then 


Yy- = Fr. 


fü = 
: 2n 
i ides 

np(p — 1) 


2n(p — 2)fi = Yi.. + Yi — 2(p — 1)np 
' 2n&jj = Yi. + Ys. — Ann — 2ng; — Ang, 


where 
A+ di t 9; 
TORTE [= + F. 2 2n(p — 24 [= + Yj. 4 2n(p — | 
2n(p — 2) 2n(p — 2) 2n(p — 2) 2n(p — 2) 


1 
- 2n(p — 2) (-2nph + Yi..-- Y. + Y;..+ I) 


1 


2 
— NG OY P eM ERE 
50 + F. ¥p. HE Y ) 


It should be noted that we do not, in fact, estimate any g; or 80; these 
quantities are not estimable. What we have estimated as g; is, 


oi c E 


(p — 2). píp — 2) as 


n-9+ 
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The total sum of squares removed is equal to 


R(u, 9, 5,7) = AY... + BGAVs-. + Yes.) + 32 8(Y ig. + Yi) 


i<j 
+ dV ga Vai), 
i<j 
4 Yan ; (Yi..4 F. t.)? gU 
pip—1)n LF 2n(p—2) p(p — 2)n 
(a) r un 
3 Et eg 
PE [X «va. ES 150 EI [= E —.— 
i<j i<j 2n 
(4) (4) 


If we fitted for u, gi, Sij we would have the same normal equations as 
the first three above, and the solutions of this set which would be de- 
noted by A, ği, 3;; are the same as before if the same conditions are im- 
posed. So 
R(u, 9, s) =a+B+y 
Similarly, 
I (u, g) ^a 8 


R(u) =a 


We have the analysis of variance (Table 6.22). 


TABLE 6.22 

Due to df Sum of Squares Expectation of Mean Square 
u 1 a - 
g p-1 B o? + 2nc?, + 2(p — no 
8 m y a? + 2nce*, 
r m D D a? + 2no*, 
Within cells pep — D(n — 1) « (say) a 

Total p(p — In 


The meanings of the components of variance are: 


1. c? is the variance between different progeny of the same cross, both 


male and female parents being specified. 

2. c?, is the average value of the square of the difference in means of 
two reciprocal crosses divided by 4. If the crossing is at random, the 
contribution to the progeny due to the fact that the male was of one 
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line and the female of the other rather than vice-versa will have variance 
On 

3. o, is the square of the deviation of the average yield of the two 
reciprocal crosses from what we would expect, given.an estimate of the 
additive values of the two lines from an infinite sample of crosses with 
different lines. 

4. o”, is defined conceptually as follows: Suppose each of the p lines 
is crossed with.a very large number of others with equal frequency as 
male parent and female parent. This will give means of, say, 21, 7», 


+++, Zp, and o”, is equal to X(x; — i). If we take a random line, 


a | 
its additive contribution is a variable with mean zero and expectation 
Pg 
The practical value of knowledge of these components is a matter for 
the geneticist. HAE 
'The expectation of the mean squares is obtained in the following 
manner. 


1.01 


Yi. — Vi. = 2nrij + sum of n different e's — sum of n dif- 
ferent e's 


| E(Y a. — Yj)? = 2ne? + Anz, 


and 
osi o on 
FP 
9 (p — 1) 
i<j 2np 
2. Bt 
(Yi. + Y.) = 2(p — Ung + 2(p — 1) 0% + 2n 32 ge. + 2n D s 
vai jai 
id + sum of 2(p — 1)n different e's 
Ea Yo ? 
E [x: 18 ) ] 
i 2n(p-—2) 


. 3p(p — D'ng | 2p'(p — Ines: | 2np(p — Des. | p(p — 1)e? 
(p — 2) (p—2) (p — 2) (p — 2) 


A GENETIC PROBLEM 117 


Also, 
Y... = p(p — 1)np + 2(p — 1)nZg; + 2n È si 
LJ 
i<j 
s + sum of np(p — 1) different e's 


| 2 ] " 2p°(p — 1) 212 — 8p(p — 10252 


p(p-2)1 . p(p— Nn p(p — 2)n 
8n?p(p — 1)e?, | 2np(p — De? 
2p(p — 2)n np(p — 2) 


Subtracting, we get, as the expectation of the sum of squares, 
(p — De? + 2n(p — De, + 2n(p — 1)(p — 2)o", 
and, therefore, the expectation of the mean square is 
c? + 2nc?, + 2n(p — 2) 024 

3. y: ` 

As regards experimental errors, we have the following in which we 
denote >> esx by eij.: (It should be noted that this is not in accordance 

k n 

with our usual notation.) Then, ' 


2n(p — 2)812 = (p — 2)(e12- + egi.) — er: — €21: — 1. — 12 


2 
ete : (e12; + €.) + other terms 
nos 
= 90-5 (eiz. + 61.) + other terms 
p 
and 
via. + Ya. - (e12- T €21-) 
Also: 
E(e12-)(e12-) = no 
Ebel) En) =9 — 690,2 


Elezl.) (et.) = no” and so on 
So the expectation of &j2(Y12- + Ya.) is equal to 
1 |^ —-8)p — 2) , (p - 3p — * E ( 3) 2 
e 


2n(p—2)l 1) (p — 1) dpi 
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There are in all p(p — 1)/2 such terms, giving as the expectation of 
the sum of squares p(p — 3)o?/2 and as expectation of the mean square 
2 
e^ 
The term involving c?, is found by an identical argument to be 2nc?,. 
As a check we may prepare Table 6.23 of expectations of sums of squares. 


'TABLE 6.23 
p? o*, 02, e? o, 
a , | np(p — 1) | 4n(p — 1) 2n 54 
€ : (n — 1)p(p — 1) 
(p—1 
à wy np(p — 1) 
— 3 
y np(p — 3) * 
B 2n(p — 1)(p — 2) | 2n(p — 1) | p — 1 
Total | np(p — 1) | 2np(p — 1) np(p — 1) | np(p — 1) np(p — 1) 


The expectations of the individual items sum to the expectation of the 
total sum of squares (about zero), so that we have verified our calcula- 
tions. 


6.9 CONCLUSION 


In this and the previous chapter we have dealt with the estimation 
from data assumed to conform to a particular class of models, of the 
parameters of the member of the class actually encountered. 

We have not discussed, except briefly at the beginning, the problems 
of inference. The work we have described is entirely deductive in that 
we assumed random samples from partially specified populations. 

There is one difficulty involved in the application of these methods to 
a set of data which can hardly be emphasized sufficiently. The results 
are obtained for conceptual populations which are formed according to 
simple specifications. The application of these theoretical results to a 
real population of experimental or observational units depends entirely 
on the validity of the correspondence between the actual population 
and the chosen theoretical population. If we have good reason to be- 
lieve that the theoretical population does not correspond to the actual 
population, we are in no position to translate deduced results in the 
theoretical population into predictions of what would happen in the 
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actual population. The correspondence is a matter of degree, and it is 
impossible to obtain a perfect correspondence. "This should not, how- 
ever, lull us into ignoring the risk that we may be on an erroneous path 
with the most complex model that we can handle. 

The acid test (and the only one) of the reliability of a model, theo- 
retical or otherwise, is the comparison of observations with predictions. 
The fact that observations agree with predictions does not prove the 
accuracy of the model but verifies that the model can predict within the 
range of error we desire at a particular moment. Later we shall be in- 
terested in smaller errors, and our model will be shown to be at best 
an approximation and at worst entirely erroneous. 

We shall find, however, in the next chapters, that we can obtain a 
considerable amount of insurance against such risks by applying the 
method of randomization. Under this principle, the experimental units 
which occur in a particular cell of a treatment classification are chosen 
at random from a specified population. 
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GHAPTER 7 


Randomization 


7.1 THE PRINCIPLE OF RANDOMIZATION 


Let us consider the basis of possible interpretations of data by meth- 
ods that have so far been given. In all cases we have to assume that 
our experimental results conform to some mathematical distribution 
which is specified to a greater or lesser degree. For example, the as- 
sumption may be that y, the variable under study, is distributed around 
some function of the other variables independently according to a nor- 
mal distribution with mean zero and constant variance. In the case 
of the tasting test, we have to assume that the taster will, in the absence 
of any difference detectable to him, choose the odd drink randomly un- 
less he knows which one of the three is the odd one. The important 
question is then: Can we ever be sure that our observations will follow 
the appropriate distribution? Fisher! gives an excellent, and now clas- 
sical, discussion of the problem, illustrating the points with the lady’s 
tea-tasting experiment. 

First, consider the triangular tasting experiment. Suppose there is 
no difference between the two processes for producing the drink, and 
that, in fact, they are identical as far as taste is concerned. Under these 
circumstances we wish the results to be in accord with the binomial 
distribution. Our taster will, each time, pick out one of the 3 drinks 
presentéd to him as the odd one. The processes by which he reaches 
a decision are unknown to us, but on tasting each drink he presumably 
scores it in some way and compares these scores. The score may, of 
course, be a composite of several characteristics and may exist only 
subconsciously in the taster’s mind. Supposing then the decision is 
based on considerations other than the treatment, because we assume 
the treatment to have no effect, we can be sure that he will be correct, 
by chance, 1 in 3 times on the average if the association between the 
treatment and any other characteristic of the experimental material is 
zero. The notion of lack of association between treatments and char- 


acteristic of the experimental material is not difficult to visualize. One 
120 
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can formalize it by an argument such as the following. We imagine 
that the experimental material can. be classified, say, for the purposes 
of argument into discrete classes, thus: , 


Treatment (j) 
. Classification 
of Material (i) 
1 2 
1 
2 


We have a process by which treatments are allocated to the experimental 
material which will specify the number n;; of experimental units in the 
(i, j)th cell. This number n;; must have the same distribution over the 
i cells for all the treatments. 

To develop a process that will have this property is a “tall” order, for 
the association must not exist for any characteristic of the experimental 
material. Furthermore, we do not know all these characteristics. The 
great contribution of Fisher to the scientific method was the notion of 
randomization. By this device, we can ensure that all the desirable 
conditions are met. 

Many attempts have been made to define randomness, but the defi- 
nitions tend to be circular. We adopt the axiomatic theory of proba- 
bility, in which we regard probability as a function of sets of points with 
particular properties. One property is that, for any set (to be precise 
and possibly a little esoteric for this book, the sets must be Borel sets) 
of points, it is non-negative and additive, and, for the set of points con- 
sisting of the whole space, it is unity. From these axioms we deduce 
certain theorems, of which the most important in the present context is 
the central limit theorem, This is a theorem entirely in our conceptual 
theory. The theorem states that, almost regardless of the true distri- 
butions of successive random variables 2, 2, ** *; their sum has a dis- 
tribution which tends to a distribution of known form, depending on 
the means and variances of the distributions of the z,’s. As a special 
case, if we are sampling from a binomial distribution, the probability 
that the relative frequency deviates from a particular value by more 
than a certain amount tends to zero with increasing sample size. Note 
that all the terms in the previous sentences are in the conceptual theory: 
ie., sample, binomial distribution, probability. Now phenomena are 
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observed in nature, i.e., in the perceptual sphere, which appear to have 
this property. For example, if we toss a penny successively in the usual 
way and plot the relative frequency of heads obtained up to each toss, 
we shall get a graph that may look like Figure 5. 


E 
3 
d 


of DL 


1 2 4 8' 16 32 64 198 256 512 etc. 
Number of tosses 


FIGURE 5. 


This is precisely the sort of thing to which our conceptual framework 
leads us. It suggests to us that the theory in the conceptual sphere 
may be related to the phenomenon in the observed world by interpreting 
probability in the conceptual sphere as rélative frequeney in the per- 
ceptual sphere. 

Again, we may examine the heights of the corn plants in a particular 
small area and obtain a histogram of these heights (Figure 6). We 


Heights 
FIGURE 6. 


realize that, with a large number of plants, finer observations, and smal- 
ler grouping intervals, this histogram will tend more and more closely 
to a smooth curve. It may never actually achieve a smooth curve be- 
cause in the present stage of genetic knowledge the height of each plant 
is regarded as made up of the small effects of a large but finite number of 
genes plus environmental effects. But it will certainly approximate a 
smooth curve. It has been found, for example, in some cases that the 
histogram can be closely approximated by the normal or Gaussian curve. 
Now suppose we have a population whose distribution resembles the 
normal distribution and we draw samples in such a way that we know 
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nothing about each individual: i.e., draw samples completely haphaz- 
ardly, and examine the distribution of the means of these samples. We 
shall find that this distribution follows closely the distribution of means 
that we can derive for the normal distribution. The crucial word of 
this statement is “haphazardly.” How can we draw samples without 
knowing anything about the individual members of the population? 
We need a process in the real world that will lead to results comparable 
to what we obtain in the conceptual world with equal probabilities. 
Here again we meet the difficulty of induction, that all we can show with 
a particular process is that it has worked in the past. 

The situation grows more and more complicated the deeper we delve 
into it, and we may perhaps best conclude this discussion by saying 
that processes have been found that give “random” numbers, which 
have the property that, if the members of our population are assigned 
successively the numbers 1, 2, 3, ete., and we use the set of random num- 
bers to draw samples, we obtain samples whose distribution in particu- 
lar respects, e.g., the mean, is closely approximated by the correspond- 
ing theoretical distribution. 

Given such a set of generated numbers, we are completely equipped 
for the drawing of random samples. We use a set of random numbers, 
because it is in most cases impossible for each and every one of us to 
carry a machine that we know will produce random numbers. Ina 
sense, we can carry such a machine, for we are pretty sure that a new 
nickel, say, has the property of giving heads and tails with equal fre- 
quency in the long run and we could generate random numbers with it. 
If we wished, we could check that the nickel has this property. It is 
perhaps worth while to indicate how we would use such a “machine” 
to arrange, say, 20 items in random order. We would toss the nickel 
5 times to obtain a random number between 0 and 31 by the following 
process: record heads as 1 and tails as 0; then we shall have 5 numbers 
which we write out in order as 


a; Gg a3 Q4 Q5 
each a; being 0 or 1. From this we calculate the number as 
as + 2a, + 4a3 + 8a + 16a, 


If all the a’s are unity, we get 5 heads and the corresponding number is 
31, and, if all tails, the number is O. If we repeat the process again and 
again, we shall eventually obtain all the numbers from 0 to 31 in some 
order, disregarding a number when we have obtained it before. We 
may then delete the numbers 0 and 21 to 31 and we have our numbers 
1 to 20 arranged in random order. 
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Such a process is rather tedious, and so we use sets of random num- 
bers prepared by someone else. There are some theoretical objections 
to the use by all of us of the same set of random numbers or to our us- 
ing the same set of numbers for all our acts of randomizing. These, 
however, need not worry us here. The ordinary experimenter will not 
go wrong if he uses a table in order and when he has gone through the 
table starts again. But, if he does a large number of randomizations, 
he should use different sets of numbers, and he should not use a set of, 
say, 10,000 numbers to arrange the numbers 1 to 5000 in order. These 
ideas are intuitive but can probably be givén some objective basis. 

What we have done essentially is to push the justification for our pro- 
cedure of randomization back a step. Any particular specified set of 
numbers may be random or not, depending on how they were obtained. 
In fact, the randomness of the numbers is not a property of the numbers 
but of the process that generated them. If they were obtained by a 
process which we believe to be random and the results of which have 
met successfully tests for randomness, we rely on the inference that 
these numbers have the desirable properties for our problems, and such 
an inference like all other inferences cannot be shown to be completely 
true. The sum total of our discussion is then that we put our faith in 
a set of random numbers. We have this to strengthen our belief in 
the process, that it has been found to work whenever it has been tested: 
for example, in sampling where we can compare our sample results with 
those obtained by complete enumeration. Furthermore, if this process 
does not work, it seems clear, though probably difficult to show, that 
no process of induction can work. : 

To return to the tasting experiment, suppose that our production 
process goes by steps 1, 2, 3, etc., to N, and that we introduced a change 
in the process at step n and wish to ascertain if this chànge has produced 
any effeet perceptible to the taster. If we divide our material at step 
(n — 1) into 3 portions and assign 1 of the 2 treatments at random to 
1 of the 3 portions, and then continue the process from the (n + 1)th 
step to the Nth step, we know that the. taster will, in the absence of 
any effect, pick out the odd one correctly by chance in 14 of repeated 
trials, in the same way that we obtain results in our conceptual sphere 
with a binomial distribution with p = 14. In order to validate the 
process completely, that is, to test the hypothesis that the change in 
the process only at the nth step has had no effect, we should apply 
processes (n + 1) to N to the 3 portions at random also, or, less pref- 
erably, in some preassigned systematic way. Suppose that our taster 
is using some effect completely unconnected with the processes at the 
nth step in order to make his choice of the odd one. Then we have by 
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our randomizing process given this effect a probability of 14 of being 
associated with the odd drink, and this is all we require to validate our 
tests based on the binomial distribution. Now consider the stipula- 
tion that the processes after the nth are to be applied at random or in 
a preassigned systematie way to the 3 drinks and what happens if this 
is done. This stipulation will result in lack of association on the aver- 
age of any external factors with the treatments. 

Finally we should consider the extent to which we should endeavor 
to make all the processes apart from the one under test as alike as pos- 
sible. It is obvious that, as far as our test of the null hypothesis is con- 
cerned, it does not matter how gross the differences are, but we haye to 
consider what happens under our alternative hypotheses. In the pres- 
ent case our alternative hypotheses are that the difference is such that 
the taster will choose the odd one correctly in a proportion p of cases, 
p being greater than 14. Gross differences occurring more or less hap- 
hazardly will lower the proportion of cases in which the differences will 
be detected correctly. In our discussion in Chapter 2 on the power of 
a test we considered only the case of p equal to 14, and then only briefly. 
Suppose we are using a 5 percent test, and we wish to reject the null 
hypothesis 95 times out of 100 on the average when the true hypothesis 
is that p equals 44. Then we shall require approximately 92 trials. 
If, on the other hand, the true hypothesis is that p equals 34, the num- 
ber required under the same conditions is approximately 13. The gen- 
eral effect of gross haphazard differences is obvious from these two cases. 
The removal of various haphazard effects will undoubtedly entail addi- 
tional expenditure of resources and brings with it an increase in the 
sensitivity of the experiment. A final answer to the balance that is 
to be practiced in this situation, namely, that an increase in the sensi- 
tivity or accuracy of an experiment requires additional expenditure of 
effort and money, is obtained only by recourse to economic arguments. 

Our general conclusion is the following. The experimenter must de- 
cide which of the various causes that he feels will produce variation in 
his results must be controlled experimentally. Those causes that he 
does not control experimentally, because he is not cognizant of them, 
he must control by the device of randomization. To reiterate the erit- 
icism of many so-called experiments in the various branches of science, 
particularly in the social sciences,“ but also of some occurrence in other 
sciences (fortunately decreasing as the principles of statistical inference 
become more widely known), only when the treatments in the experiment 
are applied by the experimenter using the full randomization procedure 


* See, for example, F. Chapin, Experimental Designs in Sociological Research. 
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is the chain of induetive inference sound. It is only under these cir- 
cumstances that the experimenter can attribute whatever effects he ob- 
serves to the treatment and to the treatment only. Under these cir- 
cumstances his conclusions are reliable in the statistical sense. 


7.2 RANDOMIZATION IN THE CASE OF CONTINUOUS 
VARIABLES 


There is little need to discuss the effectiveness of randomization in 
the case of continuous variables. The same conclusions hold qualita- 
tively as for the discrete case, but some additional remarks are neces- 
sary, in that, with the particular example discussed, the distributions 
of our results in the case of the null hypothesis were completely deter- 
minate from the hypotheses. For example, in the tasting experiment 
the null hypothesis was equivalent to stating that the results would be 
distributed according to the binomial distribution with p equal to 1. 
For any special number of trials, then, the probabilities of the possible 
results could be evaluated. There can, of course, be cases in which the 
discrete distribution is not completely specified by the null hypothesis. 

For the continuous case, consider the estimation of the differential 
effects of 2 treatments on a characteristic for which the possible measure- 
ments form a continuous set of numbers. Suppose that, with one treat- 
ment, the characteristic y is distributed for the population nearly ac- 
cording to the normal distribution 


_ way)? 
9 


1 
Sy) = ro e 


and, with the other treatment, 


m 
NT VE 


The hypothesis we wish to test is that 4; is equal to us, no assumptions 
being made about the value of c? other than that it is positive. 

The situation is exactly analogous to the problem in the axiomatic 
theory of testing the differences between samples from two populations, 
and the same considerations as with the tasting experiment hold. We 
must. select. the members of the population that receive treatment 1 at 
random. and also the members that receive treatment 2. We must 
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apply the treatments to the selected members individually and must 
randomize any stages in the process after the stage of applying the 
treatments. If the treatments have no differential effects, then our ex- 
perimental results will belong to one distribution, with 4; = u in the 
above formulas. 

The basis of our inferences in this case is that the experimental re- 
sults for the population are arranged in distributions approximated 
closely by the corresponding theoretical distributions. Our randomi- 
zation procedure by definition completes the reasoning process. 


7.3 SAMPLING FROM FINITE POPULATIONS 


The considerations that we have given above hold for particular sets 
of circumstances only. These may be stated briefly as follows: that 
we are sampling by a random process from an infinite population: e.g., 
of repetitions of the triangular taste tri-l. In any particular experi- 
mental situation it is difficult to specify any infinite population from 
which we are sampling, and, if this is possible, it is rarely permissible 
to assume that we are sampling at random from this infinite popula- 
tion, as regards the choice of experimental units which are attached to 
particular treatments. The case of field experiments is somewhat clas- 
sical in that it has been subjected to more examination than other cases 
and also has been a subject of considerable controversy. Practically 
all the difficulties of interpretation of an experiment in any subject- 
matter field are exemplified by this case, and we shall therefore examine 
it in some detail. 

Suppose we wish to compare 2 treatments on an area of land, and for 
the purpose we divide the area into plots, over which the treatments 
are distributed randomly. We know that, if we give the area of land 
a uniform treatment and harvest it in very small plots, we shall find 
that the yields are approximately normally distributed. In our ex- 
periment, however, we may perhaps divide the area into 20 plots, ar- 
range these in pairs to make replicates, and assign the treatments at 
random within each pair. The plots then that receive a particular one 
of the treatments are a sample taken randomly without replacement 
from a finite population of 20 elements stratified into 10 strata, each of 
2 elements, there being 1 element from each stratum. It is common 
sense that the yields of neighboring plots are correlated (probably ap- 
proximately as some function of their distance apart), and we know 
that 2 random elements of a finite population of n elements have a cor- 
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relation of —1/(n — 1), which with strata of 2 elements equals —1. 
In the absence of any further considerations, we could not possibly re- 
gard such sampling as being from an infinite population and could not 
therefore use the theory of previous chapters which is concerned with 
infinite populations. 
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Suppose we have performed an ordinary randomized block experi- 
ment with ¢ treatments in r blocks of ¢ plots, the treatments being as- 
signed at random within each block. If the treatments have no differ- 
ential effects, we can say that we have made a grouping of the rt plots 
into £ groups of r plots which is a random one of the possible (¢!)” group- 
ings that we could have obtained. Any property of a grouping may be 
considered, such as the sum of squares between treatment totals or the 
range of the treatment totals (or some peculiar property such as the 
cube of the means of the cube roots of the treatment totals, though it 
is unlikely that this quantity would be of interest). A chosen property 
may be evaluated for the particular grouping and for all the other pos- 
sible groupings, and we may then consider that we have a random sam- 
ple of 1 from the possible (¢!)” values that could have been obtained. 
Under the null hypothesis that the treatments have no differential effects 
on each individual plot, the value for the chosen grouping has an expec- 
tation of the average value for all the possible groupings. We may 
take any set of the values of possible groupings that has a probability 
of 5 percent and, if the actual grouping falls in this set, reject the null 
hypothesis. In this way we can be sure that we are using a 5 percent 
significance test; that is, under the null hypothesis we have a chance of 
5 percent of rejecting the null hypothesis when it is true. We need not, 
of course, go through all this work to get a 5 percent significance test: 
We need merely to reject the null hypothesis with a probability of 5 
percent according to some random device; in other words, we need not 
examine the observations at all. 

In order that our testing procedure have value, it is necessary to ex- 
amine the power of the test or the sensitivity of the test to departures 
from the null hypothesis. The criterion that we choose must be such 
that deviations from the null hypothesis tend to place the value of the 
criterion in a distinctive set of the possible values. It is with regard 
to the specification of alternatives that we encounter some difficulties. 
The simplest alternative that can be specified is that the effect of treat- 
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ment i measured from some arbitrarily chosen base is ¢; on any plot. 
The null hypothesis specifies that the £s are equal and the alternative 
that the ¢,’s are unequal. This suggests the criterion to be used, namely, 
the sum of squares between treatment means, for this sum of squares 
will contain X(t; — 0)?. This is the simplest (mathematically) positive 
symmetric function of the differences of the t;s. One could proceed 
in this fashion examining the distribution of the sum of squares between 
the treatment means, and it is only the labor of evaluating this sum of 
squares for all the possible groupings that militates against the pro- 
cedure. 

The way out of this difficulty is indicated by the theory based on 
normal distributions which we discussed in Chapter 6. For we know 
that, if normal theory and the additive hypothesis hold, we can test 
the hypothesis that the ¢,’s are equal against the alternative hypothesis 
that they are unequal by using the variance ratio criterion: namely, 
(treatment mean square) / (error mean square). It is natural, then, to 
examine the distribution over the possible randomizations of this quan- 
tity. This was done empirically by Eden and Yates ? and theoretically 
by Welch, Pitman,‘ and others. It is fairly easily shown that in the 
absence of treatment effects the expectation of the treatment mean 
square is equal to the expectation of the error mean square. It should 
be noted that the expectation is not with respect to some infinite popu- 
lation of repetitions of the experiment, but over the possible randomiza- 
tions of the treatments. It was proved by Pitman * that in the case 
of randomized blocks the criterion (treatment mean square/error mean 
square) was distributed approximately according to the F distribution. 
We shall discuss these matters in the next chapter. 

It follows that the F test may be used for testing the hypothesis that 
the treatments have had the same effect on each plot. There is, of 
course, the question of the closeness of the approximation to the dis- 
tribution of the criterion by the F test, and more work needs to be done 
on this problem. Assuming, however, that the approximation is satis- 
factory, we may, as far as the test of the null hypothesis is concerned, 
regard the observations in a randomized block experiment as having 


arisen from a model 
yg = u + bit tj ei 


i, j being the block and treatment numbers, respectively; u, bi, and tj 
being fixed unknown constants; and the eis being normally and inde- 
pendently distributed around a mean of zero with variance . We 
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must regard the error component e;; as measuring the deviation of the 
plot from the block mean, when a uniform treatment is used over the 
whole experimental area or material. It should be emphasized that so 
far we have considered the use of the analysis of variance for testing the 
null hypothesis. The analysis of variance has another use and one that 
is generally more important, the estimation of the error of treatment 
comparisons, and we shall deal with this in the next chapter. 


7.4.1 An Example of a Randomization Test 

Suppose we have 8 experimental objects, a, b, c, d, e, f, g, h, of which 
4, a, b, c, d, have received treatment 1 and the other 4 treatment 2, 
and let the experimental results be: 


a 18 ARA) 
b 13 f 16 
6. 3 g 17 
d. ty h 17 


There are 70 possible ways of assigning the 2 treatments to the 8 ob- 
jects, of which 35 lead to the same treatment difference except for sign. 
We enumerate the sets of 4 which include a, and evaluate the treatment 
differences in each case ignoring sign (Table 7.1). 


TABLE 7.1 
Difference Difference 
Set of Sets, R Set of Sets, R 
Involving (plus or Involving (plus or 
a minus) a minus) 

abed 8 acdh 0 
abce 24 acef 18 
a/ 10 aceg 16 
abeg 8 aceh 16 
abch 8 acfg 2 
alde 4 acfh 2 
abdf 18 acgh 0 
abdg 20 adef 10 
abdh 20 adeg 12 
abef 2 adeh 12 
abeg 4 adfg 26 
abeh 4 adfh 26 
ahfg 18 adgh 28 
ahfh 18 aefg 10 
abgh 20 aefh 10 
acide 16 aegh 12 
arij 2 afgh 26 
acdg 0 
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We find that in 25 cases out of the 35 (i.e., 71 percent of cases) a dif- 
ference as large as 8 (the observed difference) or larger would have been 
found. There is, therefore, no evidence from the randomization test of 
a treatment effect. 

If we applied the analysis of variance to this set of data we would 
have the results given in Table 7.2, where 


TABLE 7.2 
Sum of Mean 
Due to df Squares Square F 
Between treatments 1 8 8 0.26 
Within treatments 6 185.5 30.9 
Total 7 193.5 


Between-treatments sum of squares 
= [(18 + 13 + 3 +17) — (9 4- 16 7 17+ 17/8 = (-89?/8 = 8 


Within-treatments sum of squares — 182 + 132 + 3? + 17? 


I 
— 
oo 
ot 
Or 


Gn) + gie 17 + 17? — m = 


and 


Total sum of squares 


U 


182 ＋ 132 . 4 17 — 43 = 1706 — 1512.5 193.5 


The F value is much less than unity, and its level of significance is 
approximately 0.63. The agreement between these two methods of 
analysis, the one with very broad assumptions, and the other assuming 
normality, is such that the use of the normality assumption will not 
mislead the experimenter. T he results in Table 7.3 were obtained with 
a number of similar sets of artificially constructed data, where p(F) is 
the probability of getting the value of F or a greater one according to 
the F distribution, and p(R) is the probability of getting a more extreme 
value of R. 

If we take into account the fact that p(R) is restricted to changes of 
145 or 0.028, the agreement between the two values is surprising. It 
would appear that, in general, the asymptotic result is closely realized 


for the usual type of experiment. 
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TABLE 7.3 
Set of 
Data p(F) p(R) 
1 0.967 1.000 
2 0.960 1.000 
3 0.941 0.943 
4 0.925 0.914 
5 0.916 1.000 
6 0.858 0.943 
7 0.857 0.771 
8 0.808 0.971 
9 0.741 0.714 
10 0.678 0.714 
11 0.656 0.657 
12 0.435 0.543 
13 0.546 0.571 
14 0.435 0.457 
15 0.404 0.429 
16 0.395 0.371 
17 0.382 0.343 
18 0.296 0.343 
19 0.263 0.257 
20 0.246 0.286 
21 0.238 0.257 
22 0.165 0.257 
23 0.125 0.143 
24 0.006 0.029 


7.5 OTHER FORMULATIONS OF THE PROBLEM 


The most important other formulation of the problem is that due to 
Neyman et al5 The difference arises in the formulation of the error 
of the yield of a particular plot with a particular treatment, and of the 
aim of the experimenter. Suppose a plot in a randomized block ex- 
periment is denoted by three subscripts, 4, j, and k, the block, plot 
within the block, and treatment, respectively. The “true” yield of the 
plot (i, j) with treatment (object) k is denoted by X;;(k). The defini- 
tion of “true” yield is based on the idea that the experiment could con- 
ceptually be repeated indefinitely without any change of experimental 
conditions or of arrangement so that the kth treatment is always tested 
on the plot (i, )). A population of yields for this plot would be gener- 
ated, and X) is defined as the mean of this population. Any par- 
ticular yield obtained is denoted by z;;(k), and the difference 


rie) — XH. = e,;(k) 


is called the technical error of the particular yield (*), since it is due 
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to the inaccuracy of experimental technique. In addition to the tech- 
nieal error there is the "soil" error, or error due to the inherent varia- 
bility of the experimental units. The true yield of the jth plot in the 
ith block may be represented as follows: 


XH = X..(k) + [X;-(E) — X..(9)] + [Xa(F) — X;-(&)] 
= X..(k) + Buk) + ni(k) 
The observed yield is therefore given by 
z;(k) = X..(k) + Bik) + mis(k) + ende 


Neyman assumed that our purpose is to compare numbers such as 
X..(k), or the average yields the treatments will give when applied to 
the whole of the experimental material. In order to examine the bias 
of comparisons estimated by comparing observed yields, expectations 
are taken (1) over the population of repetitions envisaged in the defini- 
tion of true yields and (2) over the population of possible randomiza- 
tions. It is shown by Neyman that under these circumstances the es- 
timates are unbiased. 

Neyman proposed as the null hypothesis that the X ..(k)'s do not de- 
pend on k, in other words that the average yield over the experimental 
area would be the same under all treatments. This null hypothesis is 
less restrictive than Fisher's in that it is satisfied when Fisher's null hy- 
pothesis is satisfied and also when the treatments have differing effects 
on the different plots but average to zero. The question is then which 
of the two null hypotheses is the more satisfactory, and it seems that 
this is a matter of the objectives of the experimenter. If the experi- 
menter is interested in the more fundamental research work, Fisher’s 
null hypothesis is more satisfactory, for one should be interested in dis- 
covering the fact that treatments have different effects on different plots 
and in trying to explain why such differences exist. It is only in tech- 
nological experiments designed to answer specific questions about a par- 
ticular batch of material which is later to be used for production of some 
sort that Neyman’s null hypothesis appears satisfactory: for example, 
when the experiment is designed to test the hypothesis that there are 
no differences in yield between a certain set of varieties of wheat grown 
over the state of Iowa. ` 

Neyman’s hypothesis appears artificial in this respect, that a series 
of repetitions is envisaged, the experimental conditions remaining the 
same but the technical errors being different. It follows, from the above 
discussion of Fisher’s null hypothesis that there is a test of the null hy- 
pothesis of zero differences between the effects of the treatments as ac- 
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tually applied, without the introduction of any conceptual population 
of repetitions, except the population inherent in the choice of a par- 
ticular randomization. 

On the other hand, it must be admitted that, when an experimenter 
applies a treatment, say, X units of a certain stimulus, we know that 
he does not apply exactly X units, but X + 6 units, where à is an error 
variable which may be due to measuring. If the cireumstances of the 
experiment are such that this error variable has a distribution with ap- 
preciable spread, this fact should be utilized in the design. In the case 
of randomized blocks, for example, it may be suggested that under 
these cireumstances the size of the block should be twice the number of 
treatments and each treatment should be represented twice at random 
within the block. The exact effect of such a modification in the design 
has not, however, been worked out. Such a modification is of value 
also for the examination of the other possible difficulty, that the treat- 
ments have different effects on the different plots. With this modifica- 
tion it would be possible to test whether there were differential effects 
between the blocks. 
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CHAPTER 8 


The Validity of Analyses 


of Randomized Experiments 


81 INTRODUCTION 


We noted in the previous chapter that there is good reason to expect 
that tests of significance of treatment effects obtained by the analysis 
of variance, when randomization is used, are reliable, regardless of the 
distributions involved. In this way we considered one aspect of the 
analysis of experiments, but there remains the question of the estima- 
tion of treatment effects. In many respects this is the more important 
aspect particularly as it is unlikely that 2 treatments that are not iden- 
tical give exactly similar observations. The discussion of the previous 
chapter was largely qualitative, and we shall be concerned in this chap- 
ter with the analysis of experiments from the point of view of the effect 
of randomization on the estimation problem. 

The simplicity of the testing of hypotheses lay in the fact that it was 
unnecessary to specify alternatives, the randomization test intuitively 
discriminating against any alternatives. There remains, of course, the 
question of the sensitivity of the test. As regards estimation, randomi- 
zation ensures that any comparison of treatments is estimated without 
bias by the same comparison of the observed mean yields. Any ex- 
periment, then, in which randomization of treatments is used, gives a 
point estimate of the true difference, but the value of a point estimate 
without an indication of its reliability is low and, in most cases, ques- 
tionable. It is therefore necessary to consider the circumstances under 
which an error may be attached to estimates, the distribution of this 
error following some known distribution. 

There is also the further difficulty of defining exactly what we mean 
by a treatment effect. For example, suppose we consider a stimulus 
that adds a definite amount, say, 5 units, to the square root of the ob- 
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servation: then, letting ye and y; be the yields under the control and the 
stimulus, respectively, we could have results such as the following: 


Ye Vie Vie +5 = Ny Yt yt — Yo 


25 5 10 100 75 
64 8 13 169 105 
100 10 15 225 125 


On the actual scale of measurement the effect of the stimulus varies in 
the range of controls considered, from 75 to 125. If another experi- 
menter is working with exactly the same stimulus on material for which 
the control yield is in the range 9 to 16, say, and the response law is 
identical in the two cases, he will observe an effect on the actual scale 
of measurement of 55 to 65 units. Under these circumstances both ex- 
perimenters will agree only if they state their results in terms of effects 
on the square root of the observation. It is desirable then to express 
effects on a scale of measurement such that they are exactly additive. 
Such a procedure has its defects, for experimenters prefer to state effects 
on a scale of measurement that is used as a matter of custom or for con- 
venience reasons. It is probably difficult, for instance, to communicate 
to a farmer the meaning of the statement that a certain dose of an in- 
secticide reduces the square root of the number of corn borers. A 
statement on the effect on number of corn borers can be made but is 
more complex. These difficulties are not, however, in the realm of the 
experimenter. He should examine his data on a scale of measurement’ 
which is such that treatment effects are additive. The real difficulty, 
in general, is to determine the scale of measurement that has the de- 
sired property. The problem is identical with that which occurs in 
quantitative genetics, where heritabilities, genetic correlations, and so 
on may depend considerably on the scale of measurement that is used 
in their calculation. 


8.2 THE ANALYSIS OF RANDOMIZED BLOCKS WHEN 
i ADDITIVITY HOLDS 


We shall use the randomized block design to illustrate a general proc- 
ess by which randomized designs may be examined. We shall denote 
the yield with treatment k(= 1, 2, «++, f) on plot j(= 1, 2, „ t) of 
block i(= 1, 2, „ r) by yi, and we then have the identity 


ye m ees Q7 ye) yg) (ug. .-) (0 
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If we have additivity of treatment effects, we may write 

Vk — yij: = t. for allt and j (2) 
and we may then write the identity as 


Yije = n + bi + tk + ei (3) 
where 
4 = e, bi = Yi e and eij = %%. — Yi 


In fact, we do not observe the yield of treatment k on plot j but merely 
the yield of treatment k on a randomly chosen plot in the block. If we 
denote the observed yield of treatment k in block 7 by Yik, we may write 


Vk = nd bi + t + D se (4) 
j 


where 6%, is equal to unity if treatment k occurs on plot j in the ith block 
and is zero otherwise. The random error attached to any observed yield 
is the whole expression O dhe. Any particular ej; is a fixed variable 


which we do not know. : The random variable in the expression 4 is 
the term ô$, and its distribution is determined by the randomization 
procedure which is used in obtaining the particular experimental plan. 
The properties of the 8078 which are necessary for our purposes are as 
follows: 


Prob (85 = EL for any 1, j, k 


—— 


Given that 
5% = 1, then 83-0 forallj' 7j and 55 = 0 forallk'zk 
5% und à are independent if 
i xd for any j, j’, k, K. 
Given that 
àp = 1, prob (of = 1) = 


; for j * , * Ak 

These properties are an expression of the fact that we randomize the 
positions of the treatments in each block separately and, of course, that 
a treatment occurs on only 1 plot in a block and that any plot receives 


only 1 treatment. 
Now let us examine the estimates of treatment effects. A treatment 


total V. or T, is given by 
T, = ru + rie + È È byes (5) 
7 1 
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The expectation of ài; is 1/t, and, because Lei = 0, the expectation of 
j 
the treatment total is ru + rix. Similarly, the expectation of any com- 


parison of observed treatment means is the same comparison of treat- 
ment effects. The variance of a treatment total is equal to the expecta- 


tion of (x Di 10 . 
Si od 
Now 


(x > thes) = — — (0i) ei + D X Nue 
— 4 


i j'»mj 


*TÀAXIXG4ees (6) 


imi j j 
Using E(6) to denote the expectation of the quantity 0, we have 
PAN 
El)? = - 
E(MAy =0 forj ¥ j 
Ebay) = d for i' #7 i,j’ 
(80085 g for’ Ei and any j, j 


Since >> e;; equals zero, we have 
j 


E(T, — E(T,)P = : Ley (7) 
Similarly, we find that 5 
E((T. — E(T))Te — E(T4)) = - ——— Ye, (8) 
p 1) 7 
that 
E{((T, — Ty) — ET.) — E(Ty yy? = — i= ei (9) 
and that 
BK, By) OE INE uc Ey 00 
ü 


where T, is the treatment mean: i.e., T,/r. 
The estimation problem is solved to an appreciable extent then if we 
can find a quantity whose expectation is a known multiple of $^ e°; 


ij 
and if we can make statements about the joint distributions of the esti- 
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mates and their errors. The method of estimating >> e?,; is based on 


1 
the analysis of variance, involving a division of the total sum of squares 
into portions for blocks, treatments, and error. For we have the iden- 
tity 


x (YR — 02 = S (yi. — J.) + ex ( — y-)? 
+ x (Yik — Yi: — Va y» 


1 
where as usual y;. — A > Yik, and soon. The expectations of the terms 
k 
on the right-hand side are easily obtained. The first term, the block 
sum of squares, is a constant and equal to {=b?;. The second term, the 
treatment sum of squares, is also expressible as 


1 zT? 
ly p, - f k) 
T * 


rt 
and the quantity ET, is equal to rtu and contains no errors. The expec- 


1 
tation of the treatment sum of squares is then 7 260 + rte. The 


total sum of squares, that is the quantity on the left-hand side, is equal 
to Ces, + EP, + (EU?;, and the third term on the right-hand side may 
be obtained by subtraction. Thus we have the analysis of variance 
(Table 8.1). 


Taste 8.1 
Expectation of Sum 
Due to Sum of Squares of Squares 
Blocks US (yi. — y? The, 
7 
1 
Treatments LG - 1. 92 7 P» et + ri 
7 


5 r-l 
Remainder Dye = ve — ye ty)?  —— x ei 
ik 


Total T — 1. ) D ey t + Eber 
ik * 


If we divide the remainder sum of squares by (r — 1) f — 1), we ob- 


1 : 
tain a quantity whose expectation is Go) I eij, and, if we denote 
rt — ij 


this by a°, the variance of a treatment difference is 2c?/r. We may in- 
troduce the degrees of freedom for the remainder or error sum of squares 
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of (r — 1)(t — 1) for this reason if we wish, though we usually justify 
this number because the error sum of squares is the sum of squares of 
(r — 1)(t — 1) linearly independent quantities. Also, if we divide the 
treatment sum of squares by ( — 1), its degrees of freedom, we see 
that the expectation of the treatment mean square is 


1 125 
N * um ; 


If there are no treatment effects, the expectation of the treatment mean 
square is equal to the expectation of the error mean square. This is 
the property of unbiasedness, which is an essential property of an ex- 
perimental design. 

We see, therefore, that any comparison of the treatment effects 


EM, with TN = 0 


is estimated unbiasedly by the same comparison of the observed treat- 
ment means, with a variance equal to 


2 
(234 — 
Tr 


where o” is the expectation of the error mean square. It should be 
noted that we have used no assumptions about the errors, except that 
there are fixed deviations of plot values from block means, which are 
attached at random to the treatment yields. We have used no assump- 
tion of homogeneity of errors, using the word "error" to denote the 
quantity 2 D which is the error of the observed yield, nor have 
we assumed that, for example, Le, is the same for all values of 7. 
J 

It remains to us now to consider the distribution of estimates and 
errors. 

We shall first consider the test of the hypothesis that there are no 
treatment effects: that is, that the 's are all zero. For this purpose it 
is necessary to obtain the distribution of the treatment sum of squares, 
the error sum of squares, or the criterion of {treatment mean square/error 
mean square) over the (/!)" possible randomizations in the absence of 
treatment effects. We note that, if we denote >> e°; by S, the sum of 

a 


the treatment sum of squares and the error sum of squares is then equal 
to S. We have already found that the expectation of the treatment 
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sum of squares T is S/r. After some straightforward but tedious al- 
gebra, it is found that the variance of T over the population of randomi- 
zations is | 


2 SERIA 
enue (S? — K) (11) - 


where 


K p 2) | (12) 


If the errors of the blocks are homogeneous, then 2] e?;; = S/r for each 
a 


i, so that K = S?/r, and the variance of T is 


2(r — 1) (13) 
(t — 1)? 
If the e;;'s were normally and independently distributed, the quantity 
T S-T 
— / __* —— —— would follow the F distribution (cf. Chapters 5 
1 — V C =) 


and 6), and the quantity T/S would fol'ow the beta distribution, 


m+n 
r( « 


Saab (14) 


f(z) = 


where m = (t — 1) and n = (r — 1)(t — 1), the degrees of freedom, re- 
m 


spectively, for T and S — T. The mean of this distribution is 


m+n 


and the variance is 
2mn 


(m + n)*(m +n + 2) 


If the distribution of T/S is to be representable by the beta distribution, 
the two distributions should at least have the same mean and variance. 
The mean of the distribution of T/S is 1/r, and the mean of the beta 
(t— 1) 
distribution is Gope-n+¢-D —De-p+0-D 
ance of the distribution of T/S we have found to be 2(r > 1)/(t — D?, 


which equals 1/r. The vari- 
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under certain specified conditions. The variance of the beta distribu- 
tion is very elosely approximated by 


2(r — ) — 1)? 2(r — 1) 
re- DP * (= 


if 2 is small compared to r(t — 1). The agreement is remarkable, and 
we may conclude that, if the error variance is the same for all the blocks, 
the distribution of T/S is fairly accurately represented by the beta 
. distribution. It then follows that the distribution of the quantity 
T (S — T) 
t= M (r—1(t— 1) 
square/error mean square) is fairly accurately represented by the ordi- 
nary P distribution. This was proved by Welch! and Pitman,’ the 


latter also making an examination of the third and fourth moments of 
T/S. ; 


or, in words, of the criterion (treatment mean 


If we denote Lo ei by S; so that DS; equals S, and — T by S, the vari- 


ance of T/S ov 5 the population of randomizations is 85 to 


2 g 
— 5 5 20 — 5°] 
(t — ell r ( 5) 
or . 
Ar - 1) : r X(S;- aa 
P(t— 1) reni cust 
or 
2(r—1 X(S; 8)2 
(r ak X ) | (15) 


(t — 0)? r(r — 1)8? 


If the errors of the blocks are homogeneous, S; equals S, and we have 
the previous expression again. , 

Heterogeneity of the errors does not affect the mean of the distribu- 
tion of T/S but reduces the variance. As an example of the effect of 
heterogeneity, let us suppose that we have an experiment in 4 blocks 
and that one of the blocks is 3 times as variable as the others. Then the 
variance of the distribution of T/S will be Lé less than if the error vari- 
ances were homogeneous. If, in addition, we suppose that there are 
6 treatments, the parameters m and n of the beta distribution, which 
closely represents the randomization distribution, are given by the 
equations, 
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m 1 2mn 206 — 0) 8 
or men r 3 -nD9* 9 

m EN. 2mn Nu 

mtn 4 (m+n? 60 


The solution to these equations is m = 96964 and n = 3m. In order 
to obtain the level of significance by the randomization test, we should 
then compare the criterion (treatment mean square/error mean square) 
to the F distribution with about 6 and 17 degrees of freedom, instead of 
the F distribution with 5 and 15 degrees of freedom. The general effect 
of heterogeneity of errors will be that the ordinary use of the F distri- 
bution underestimates the level of significance of the randomization 
test. Just how much the underestimation will be in a particular situa- 
tion may be calculated on the lines of the example above. Although 
there remains the problem of the accurate evaluation of the difference 
‘between the approximation and the true value and the size of experi- 
ment necessary for this difference to be small, we may rely on the F 
distribution to give us a sufficiently accurate evaluation of the level of 
significance except for very small experiments. 
We found above that any treatment comperison 


$us 
k 


is estimated by 
LI 
7 


with a variance equal to 


2168 


(2M 7 
r r(t—1) r(t — 1) 


The expectation of the error mean square E is S/r(t — 1), which we 
have called c?, and so we shall state that the estimated variance of the 


1 
or CM 
T 


1 " 
estimate of the comparison is — (SE. In order that this statement 
r 


may be of value to us, however, we need to be able to assume that the 
t distribution or some other easily handled distribution holds for the 
ratio of the error of the comparison to the estimated standard error of 
the comparison. In this connection we must note that the distribution 
of the error sum of squares has a mean of (r — 1)(t — 1)o?, and a vari- 
ance equal to that of T, because S is a constant: that is, a variance of 


ac DE or = DESY) „. With the normal model theory of 
(t— Dn? r 
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Chapter 6 we noted that the error sum of squares was distributed as 
x20” with (r — 1)(t — 1) degrees of freedom. This distribution has a 
mean of (r — 1)(t — 1)o”, and a variance of 2(r — 1)(¢ — 1)e*. The 
fact that the variance of the error sum of squares under randomization 
is less by a factor of r could have been expected from the fact that in a 
sense we are considering the sum of squares of a random sample of 
(r — 1)(t — 1) deviates from a finite population of r(t — 1) deviates. 
There does not appear to be a strict justification for using the test for 
individual comparisons, but rather we rely on the general applicability 
of the ¢ distribution to a wide range of problems. 

We may note that we can construct a set of (t — 1) normalized or- 
thogonal comparisons of the treatments, say, 


Din, p 1,2 t-1 (16) 
. k 
with 


È Ave - 0, Doe =1, and LMO =0, p'*p 
k k k 


Each of these comparisons may be estimated in each block by the corre- 
sponding comparison of yields, and it is easily verified that in block 7 
the estimate, say, Cpi has a variance of L 62% ( — 1) and that the 


j 
comparisons are uncorrelated. If we denote >, €?;;/(t — 1) by o°; and 


J 
consider any one comparison for all the blocks, we have r uncorrelated 
estimates of this comparison with variances 921, 072, +--+, o?,, respec- 
tively, for each estimate. The assumption of homogeneity of errror 
that we made above is the assumption that 


eiu mem) rz 


If this assumption is true and we make up a set of orthogonal compari 
sons and obtain an error sum of squares for each with (r — 1) degrees 
of freedom, then we should find that the (t — 1) sums of squares are 
homogeneous. It does not appear likely, however, that Bartlett's test 
of homogeneity of variances would apply to this case, because we noted 
above that the total sum of squares for error is not. distributed approxi- 
mately as x over the possible randomizations.* 

This brings to light an additional point in regard to estimation, that 
it is desirable that the variance within the blocks be constant, for we 
know that, if we have uncorrelated and unbiased estimates 4; of a pa- 
rameter y with variance c?;, i = 1, 2, «++, n, the best linear unbiased 

* An empirical examination by W. D. Barclay (M.S. thesis Iowa State College) 


has indicated that t tests are satisfactory but that Bartlett's criterion does not have 
the appropriate distribution over randomizations. 
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estimate of y is 
— 75 
A 


which has a variance of 


1 
Lx 


We shall always use arithmetic means in a randomized block experi- 
ment, and the variance of the arithmetic mean is 


sre) 


If the c?;'s vary considerably, we may have very inefficient estimates. 
For example, if we have two estimates, 7; and 92, with variances of 1 
and 11, respectively, the variance of the arithmetic mean is 3, which is 
3 times the variance of the estimate 4; alone. The variance of the 
weighted estimate is 1149, which is, of course, lower than the variance of 
41. It is desirable from the point of view of estimation therefore that 
the variances within blocks be approximately the same. We may ex- 
pect that F tests will be more accurate in this case also, as we Lave seen 
earlier. 

We have not given the results for the completely randomized design 
because they are essentially the same as in the randomized block case. 


\ 


8.3 THE ANALYSIS OF RANDOMIZED BLOCKS WITH 
NON-ADDITIVITY 


We now formulate a model in which additivity does not hold. Con- 
sider any block given by the subscript i, the plots within the block given 
by the subscript j, and the treatment given by the subscript k. Let 
vise be the yield of plot j in block i under treatment k. In performing 
an experiment we obtain a balanced sample of the y;;;s. We may 
write 
Yijk = Y- + (V = Ya.) 4 (yij- m VN.) + (y--k e: y...) 

+ (ik — Vies — York ye) G — Yi — vesc ye) (07) 


This is an algebraic identity, the replacement of a subscript by a dot 
indicating that an average over the values of that subscript has been 
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taken. The terms on the right-hand side have practical meaning: 


1. y...: the mean over the whole experiment, if each treatment could 
be a to each plot. 

2. yi.. — y...: the deviation of the block mean from the over-all 
mean, averaging over ali treatments. 

3. y. — Vis : the deviation of the jth plot from the block mean, 
averaging over all treatments. 

4. y..k — : the deviation of the kth treatment from the over-all 
mean, averaging over all plots. 

5. (Yik — Yi- — Vk + y---): the deviation of the effect of the kth 
treatment in block 7 from the effect over all blocks. 

6. (%% — Yije — Vix + yi): the deviation of the effect of the kth: 
treatment on the jth plot of the ith block from the average effect in the 
ith block. 


We now take into account the fact that we observe, say, Vil; which 
equals the yield of the kth treatment in the ith block and which occurs 
on a randomly chosen plot. It should be noted that we distinguish the 
members of the population of possible results y;;; from the observed 
result Yiv, the latter containing only two subscripts, one for the block 
and one for the treatment. 
Then, 

Yik = u + bi + tk + ei + (bl)ik + mk (18) 

where 
=Y., b; = yi... — s ly = Yk m y 


cik is the random variable which takes the values yij. — yi.. if treat- 
ment k occurs on plot j, ] 


(bi) = (yi — Yi J K T V) 


and is the same regardless of the plot to which treatment k happens to 
be allocated, and 


"ük = (ik — Vi: — Vick + Yi) 
if treatment k occurs on plot j. 

We note that the difference between this model and the one we had 
previously is that the present one contains two additional terms. The 
first, (t) u, measures the extent to which effects differ from block to 
block and is not a random variable unless we consider that we have a 
random sample of some population of blocks. The second, nijk, meas- 
ures the extent to which the effect of the kth treatment on plot (77) is 
different from the effect of treatment k averaging over the plots in the 
ith block and is a random variable as far as treatment k is concerned. 
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A method of writing the model which exhibits the random variable 
nature of some of the terms is to use the symbol 5 of the previous sec- 
tion. The model then becomes 


ya = A + bi + tr + Wat DX dhe + DX sini (19) 
i j 


It is instructive to examine what the usual estimates in fact estimate, 
if this is the true model. Since 


: 1 
E) == (ba = D Ox = 0, Ye; = o, and DY nije = 0 
i k j j 

f (20) 

a treatment total >> y; has an expectation of 

: ru + rb. + rtk 

i.e., the observed treatment mean estimates the mean that would have 
- been obtained had the whole of the experimental material been sub- 


jected to treatment k. 
` Now let us examine the usual analysis of variance (Table 8.2). 


TABLE 8.2 
Due to df Sum of Squares Mean Square 

1 4 

Blocks r-1 12 N. Y?../rt 
1 : 

Treatments 1-1 2» Y?4 — Y?../rt 

Error (r — 1)(t — 1) By subtraction 

Total 11 — 1 LV — Y?../rt 


It is à straightforward job to evaluate the expectation of the respec- 
tive sums of squares and, hence, of the mean squares. As an example, 


consider Y?;. Now, 


Y; = tu + tb; + DD ea + — D mn 
4. * j 


ES Dd a = 1 and Leu = 0 
5 k j 

Y, = i bi DD dine 
and n 


i 2 
YA. = Pp? + PU; + Wubi + Ua + b) L 22 ni + (x zi dia) 
Er j 
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Now, 1 
E65 = i and X (nij) = 0 
d» GN 
so that 
E(2t(u + b) L E mi] = 0 
Also, igi: 
2 
(x om ina) Lon X L (ob) (SH nuage 
kj kj k'æk j 
+E Lö ene X L oyinini 
and, since pet ds 
, * 1 
Ej) ] = 7 
800% 0, * žk 
9050, = 0, jszj 
and 
E556 , j, ky k 
(So 0 70 — 1 IES 
we find that 


1 é 
25 Z0 NijkNij’k’ 


tt Eg 1) k'smk 7 21 


1 
Domus: 


deer 
E (x x dina) =- nit 
5 tn 


i 1 
— >> Tk — 


t tt — 1) e 7 
. Xu 
ty 10 1 7 
1 
= — L (21) 
717 


The expectation of all the other terms may be evaluated similarly, and 
the result shown in Table 8.3 is obtained, where 


Sisk = en + nik 


TABLE 8.3 EXPECTATION or MEAN Squares UNDER. RANDOMIZATION 


Due to df Expectation of Mean Square 
Blocks r-1 won X "ut sm 
Treatments 121 x EU - a N 91 * — r^ 
Error 6 = = a »» tia - XA k LUE v 2 6.1 


Total m=i 
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We have incidentally proved again the unbiased character of the ran- 
domized block design under the null hypothesis that the treatments 
have identical effects on all plots, for, in that case, 


Nijk = 0, all i, F k 
(b); = 0, all i, k 


It should be noted that we are considering the estimation problem. 
The analysis of variance given in Table 8.3 is entirely irrelevant from 
the point of view of the testing of the hypothesis, that there are no 
treatment effects, for we have obtained the expectations over the popu- 
lation of possible experiments that we could have obtained. As re- 
gards the testing of the hypothesis, we shall obtain one experiment 
only, and we shall apply the randomization test procedure to that one 
experiment. This test procedure would consist of superimposing all the 
possible randomizations on the set of yields we would obtain in the par- 
ticular experiment and evaluating some criterion for each randomiza- 
tion. If this criterion is in the critical region, we reject the hypothesis 
that there are no treatment effects. It is difficult to visualize the effect 
of non-additive treatment effects on the sensitivity of this test: that is, 
on the proportion of the possible experiments we could have obtained 
with particular non-additive treatment effects, which would have indi- 
cated by the randomization test that there are treatment effects. 

If the treatment effects are not additive, the observed mean of a 
treatment will estimate the mean yield we would have obtained had 
the whole experimental area been subjected to that treatment. Com- 
parisons of these means will be of value to the experimenter, because 
they give estimates of treatment differences over a well-defined popula- 
tion. It is necessary, however, to consider under what cireumstances 
we may attach a standard error to these means which can be interpreted 


in the usual manner. If we write 


yi = uc bi + tk (bis + ecm (22) 


it is easily found that 
1 
E(éà) = 7 X (vise — vc 
j 


1 , 
E(eata^) = i= 1) — (ue — Viae — Yir) * #k 


Elesker) =0 for any k, E and ix Ü 
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If we could assume that 
: — (% — Yer)? = oa (23) 
is constant for all blocks and treatments and equal to c?;, say, and that 
: — (ar — yia) ae — View) = 00h (24) 


for all 7’s and all k’s and "s, the variance of a treatment comparison 


» Nd -ks DE = 0 
ru 
would be 


2 
AE co : 5 
2 (25) 


Furthermore, if the terms (bé);, are zero, the expectation of the error 
2 
mean square is equal to kb ( T A) If E is the observed mean 
> z 3 


square, the variance of the comparison would be estimated by (ZN), 
. which is the usual process. 

The above assumptions are, however, not easy to justify from a prac- 
tical point of view. The constancy of o° appears fairly reasonable, 
though it is likely that % depends on k unless the treatments are addi- 
tive in their effects. The assumption of constant correlations is not 
entirely reasonable because, if 2 treatnients k and k’ are, in fact, iden- 
tical in their effects, the assumption that 


ep 


— (% — e — Via) = pos 
implies that i 

a 25 gk * yi ay - po? 
bj 


whereas we have already assumed it to be equal to aĉ. Since, however, 
p cannot be greater than unity, the effect of the correlation term in the 
variance will be small if we have several treatments. 

It appears therefore that we can justify the usual process of estimat- 
ing the errors of treatment comparisons if we can assume that % is 
constant and that there are no block-treatment interactions. If the 
assumption that the block-treatment interactions are not zero is in- 
correct, we shall overestimate the standard error of the treatment com- 
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parison, as an estimate of the true treatment comparison for the whole 
experimental area. The applicability of the ¢ test when block-treat- 
ment interactions are negligible, cannot be examined without postulat- 
ing some distribution of the terms (/ — yi-x). It may be suspected, 
however, as for the case when additivity holds, that the usual t test is 
somewhat conservative. 


84 METHOD OF ANALYSIS USED IN SUBSEQUENT 
CHAPTERS 


The methods of analysis of experimental data given in Chapters 5 and 
6 are based on a model containing fixed environmental and treatment 
effects with an error which is normally and independently distributed 
around a mean of zero with constant variance (or known relative vari- 
ances). The difficulty inherent in this approach is that the population 
of experimental units and repetitions of the experiment about which 
the inferences are made are unspecified. For this reason we considered 
it desirable to examine the possibilities of making inferences about the 
experimental units actually used. The analysis given above for the 
case when additivity holds is based only on the repetitions given by 
the set of possible randomization patterns. It provides a test of the 
effects of the treatments as actually applied on the experimental units 
used. 

It should be noted, however, that the analysis given in section 8.2 
concerns certain errors only; in that we suppose that, if treatment k is 


placed on plot (ij), the yield is given by 
Yik = Tij +h 


The quantity e;; which we have used in earlier sections may be called 
the plot error, and the analysis of section 8.2 dealt only with these plot 
errors, In general, we may expect that there will be other errors due 
to variations in experimental technique, or extraneous factors. These 
variations should have small effects, and, if, for example, variations in 
experimental technique, such as the exact amount of stimulus applied 
to an experimental unit, cannot be considered small, further definition 
of the problem under investigation is necessary. From the point of 
view of estimation of treatment differences, we therefore adopt the 


model : 
yi = ud bi + t ei (26) 


where the error ej now contains the plot errors and the other errors. 
We have seen that orthogonal comparisons of treatments within the 
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blocks have plot errors that have expectation zero, are uncorrelated, 
and have the same variance. We may assume that the errors due to 
extraneous factors are uncorrelated, with expectation zero and constant 
variance. i 

Therefore, in the model 26, the quantities u, be, and ¢ are fixed un- 
known constants, and the e;;'s may be regarded as being uncorrelated, 
with expectation zero and constant variance, because, using this model, 
we shall estimate treatment comparisons by within-block comparisons. 
This model we shall term the finite model, and it is the one we shall use 
for most purposes. We prefer it to the infinite model which has the 
same components but in which the e;x’s are assumed to be independently 
normally distributed, because the main component of the errors will 
usually be the plot errors, and these are not normally distributed. For 
tests of significance we shall rely ón the approximation to the randomi- 
zation test by the F test and on the assumption that the normal theory 
tests may be used for tests of individual comparisons and similar ques- 
tions, realizing that they may possibly be somewhat in error if there are 
only plot errors. Wé shall regard the inferences that we make as being 
inferences about the experimental units actually used, the extrapolation 
of these to a broader population being a matter of judgment in the 
present state of knowledge. This is not, of course, the case when a 
broader population is introduced at the beginning of the investigation 
and random samples of it are used. 

The main requirements on the use of the model are that we have ad- 
ditivity of treatment effects and that we have homogeneity of errors. 
The main device to obtain these is the use of a transformation, and this 
is discussed in a later section. The two requirements are not necessarily 
consistent, and it appears that additivity is the more important one, 
because we may expect plot errors to be the more important ones 
generally. 

Occasionally, we may find that no simple transformation of the data 
appears to give a reasonable approximation to additivity. We may 
then consider orthogonal contrasts among the treatments and evaluate 
an error for each with (r — 1) degrees of freedom. Such a procedure in 
a small experiment has doubtful value when the orthogonal contrasts 
are made up on the basis of the observed yields, for we are then using 
a procedure the operating characteristics of which would be very diffi- 
cult to ascertain. If the interpretation made of the experiment de- 
pends at all markedly on the choice of orthogonal contrasts, we may 
conclude that the experiment is of little value. 

There is considerable discussion in the literature of the problems we 
have examined, and we may refer the reader to the papers by Neyman 
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et al? and McCarthy * on the problem of tests of hypotheses that the 
average effects of treatments are identical. We may also refer the 
reader to the paper by Anscombe * for a discussion of the general prob- 
lem of inference from experiments. - 
We may conclude this section with the observation that, even if our 
inferences from experimental designs are open to some criticism, we can 
take the position that we are following rules of action and interpreta- 
tion of which we know the operating characteristics under perfect con- 
ditions and for which there appear to be no good substitutes. There 
are three separate parts of the whole procedure which can be altered. 
First, we can decide to take observations according to some pattern 
other than a randomized pattern; that is, we can use a systematic de- 
sign. There is an extensive discussion of this point in the literature, and 
we may refer the reader to Fisher,“ Barbacki and Fisher, Yates? and 
Student.^** Insofar as there is no possibility of estimating the errors 
of treatment comparisons for systematic designs even when additivity 
holds, without very considerable replication or prior knowledge, we shall 
not consider the systematic designs at all in this book. The joint prob- 
ability distribution of the numbers dei determines the pattern of obser- 
vations to be taken, and, although it would perhaps be interesting to 
consider distributions other than the one that is generally used, it is 
clear from the derivation of the estimates and errors of estimates in 
section 8.2 that recourse to à distribution other than the one used would 
render the estimation of errors very difficult even with additivity. 
Second, we may consider different tests and test criteria to be applied 
to the data of the individual experiment. The randomization test is 
preferred because no assumption of distributions is necessary. The use 
of the criterion (treatment mean square/error mean square) is deemed 
best because we can obtain reasonably accurate significance levels for 
this criterion very easily. ‘The fact that the test based on this cri- 
terion has optimum properties with samples from normal populations 
is an additional reason of some force. 
The third part of the process is the estimation of effects, and the pro- 
cedure we follow does not appear to have a preferable substitute that is 
manageable and realistic. 


8.5 TRANSFORMATIONS 


We have mentioned the problem of the choice of scale of measure- 
ment, and we have seen that, if we can find a scale of measurement on 
which treatment effects are additive, the examination of the experiment 
and the presentation of the results are straightforward. Since we shall 
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not usually be able to specify a scale on which effects will be additive, 
it is necessary to consider means of examining the experimental data 
to discover non-additivity. We shall in a later section describe Tukey's 
test for non-additivity, which is however based on normal or infinite 
model theory. As a rough test we may utilize the fact that we can par- 
tition the error sum of squares into (¢ — 1) sums of squares, each with 
(r — 1) degrees of freedom. It is unlikely that we can test these accu- 
rately by Bartlett’s test as we have already noted. However, if they 
are markedly different we may need to examine some transformations. 
A better procedure, if there are small block differences, is to examine 
the range r for each treatment in relation to the mean m. If this ex- 
amination suggest that r = g(m), we may be fairly confident that the 
transformation given by i 
fw) = |= (27) 
: J gly) 
will result in closer conformity to additivity. This procedure is sug- 
gested by normal theory, in that the range will be proportional approx- 
mately to the standard deviation. If c, = g(y), then approximately 
var [f(y)] = (f’(y)Plg(y)], and, if the variance of the transformed vari- 
able f(y) is to be constant, we must have 
5 1 dy 
=— or = |— 
neg Ria NET 
Thus, if the range appears to be proportional to the mean, a logarithmic 
transformation will be useful, and, if the (range)? is proportional to 
the mean, a square root transformation should be made. 

It we use normal law theory in the analysis of experiments, the essen- 
tial conditions for the applicability of the methods of Chapters 5 and 6 
are that the yield be composed additively of environmental effects, 
treatment effects, and error, the errors being normally and independently 
distributed with mean zero and constant variance. If we are using a 
linear model, the minimum conditions for the application of least squares 
are that additivity holds as before and that the errors are uncorrelated 
with zero mean and known relative variances, preferably constant. 

It is, perhaps, unnecessary to state that, if a transformation is used, 
the best estimates of the treatment means on the untransformed scale 
are obtained by transforming back the means of the transformed variate. 
Similarly, confidence intervals must be obtained on the transformed 
variate. 

In general, in the analysis of experimental data, our procedure is to 
obtain a transformation that results in homogeneity of error variance 
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and to assume that deviations from additivity on the transformed scale 
are small. Heterogeneity of error variance usually arises from a rela- 
tionship of variance to mean and will often be due to non-additivity, so 
that our choice of transformation depends on the relation between vari- 
ance and mean of observations. This relation must be determined gen- 
erally from the actual data by a device such as that mentioned above 
of comparing the mean under treatments with the range. Another de- 
vice which is occasionally helpful is to examine the deviations of ob- 
served values from what would be expected with additivity and con- 
stant variance. A plotting of T 


| za — 2; — 2. T2. 


against 2x; will indicate whether a transformation has been reasonably 
successful. ; 

A transformation may be suggested on the basis of the method of 
collection of the observations. If, for example, we are observing: pro- 
portions by examining a random sample of individuals within each plot, 
we know that the variance of an observed p is 


P(t—P) 
n 


where P is the true proportion. It is easily verified that the appropriate 
transformation is sin! Vp, and, furthermore, if there is no hetero- 
geneity between the plots, the variance of the transformed variate will 
be 0.25/n or 821/n, according as sin Vp is measured in radians or 
degrees. 

The term heterogeneity as used here should be defined more precisely. 
Suppose we are performing an experiment to determine the response 
curve of a biological population to some killing drug, and for the pur- 
pose we draw 4 random samples of, say, 20 individuals, these samples 
being exposed to doses of 0, 1, 2, 3 units of the drug, respectively. The 
number that die at each dose is recorded. Now it may possibly be (and 
is frequently) assumed that the distribution of the tolerance (the amount 
of drug that will just kill an individual) in the population is one of some 
specified family of distributions. It is possible that experimental con- 
ditions are so well under control that the only differences apart from 
treatment between the groups tested with various amounts of the drug 
arise because they are different random samples of the same population. 
In other words, it is possible that there are no extraneous forces that 
cause groups treated with the same amount to vary more than would 
be expected under the binomial law. If the groups were, for example, 
exposed to the drug on different days, one would expect that environ- 
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mental forces would tend to cause greater variation. The statement 
“if there is no heterogeneity" is then interpreted as meaning in the 
absence of extraneous factors producing variation. Heterogeneity is es- 
sentially the same as the existence of plot errors, which we discussed 
earlier. The transformation obtained in the above way is not designed 
to deal with the extraneous variation, though it may well do so. In 
particular instances the effect of the heterogeneity may be small, but, 
on the other hand, it does not seem reasonable to assume that there are 
no plot errors. No transformation may be expected to work perfectly, 
and it is this fact more than any other that vitiates extensive computa- 
tions to fit a computationally awkward transformation. 

With these remarks in mind we list in Table 8.4 from Bartlett "° 
transformations that have been found to have practical value. 


TABLE 8.4 
Approzimate 
Variance 
on New 
Scale in 
Variance in Absence of 
Terms of Hetero- Parent Refer- 
Meanm Transformation geneity Distribution ence 
m YzorVz4i 0.25 Poisson 1 
Mm for small integers 0.25)? Empirical >$ 
Amt loge z, log, ( + 1) M 
logio z, logio (z + 1), 0.189)? Empirical 
2m? 2 
loge z Sample variance i 12 
n — 1 Z "—1 j 
mil — m) sin^! V z (degrees) 821/n : J 
n [pd Vz (radians) 0.25/n BIO 2 
km(l — m) sin! Vz (radians) 0.25% Empirical 
261 — m)? z 1 X. 
** — m) log, ( = =) X Empirical 
1 — m3? 1+ 1 
LA 4 loge Gu ar Sample correlation 14 
X7! sinh“! O 
m + Mn! or A^! Sinh! QVz-alh 0325 Negative binomial : 15 
for small integers " 
utm + Mm!) X7! sinh"! O 0.25, Empirical 
or^! sinh7! AW 2 + 1) 
for small integers 


In addition to these transformations, for which the transformed vari- 
ate has constant variance if the basic distribution is as specified, there 
are 2 transformations that have been used extensively in biological assay 
which do not have this property: namely, the probit and logit transfor- 
mations for variates which take values between 0 and 1. In the probit 
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transformation the variate which is a proportion is replaced by the 
deviate of the normal distribution equal to the variate below the deviate. 
The book Probit Analysis (by Finney “) contains a comprehensive ac- 
count of applications of this transformation which have been used. In 
the case of logits, instead of the normal distribution,the distribution 


f(x) dz = $ sech? x dz 
is used, and the proportion p is replaced by z = !$ log ten: The 
logit transformation is also indicated when the response of the experi- 
mental unit to the stimulus tends to behave as an autocatalytic reaction 
(Berkson v). This distribution and the normal distribution can be made 
virtually indistinguishable experimentally by suitable choices of 
scale. ; 

A transformation that has some intuitive appeal has been used to 
apply the analysis of variance to ranked data (Fisher and Yates “). 
The observations are obtained by ranking objects given the various 
treatments in order of preference, say, 1, 2, - - -, 10 if there are 10 treat- 
ments. The procedure is to replace the rank r, say, these running from 
1 for the best to n for the worst, by the expected value of the rth largest 
of a sample of size n from a normal distribution of mean zero and unit 
variance. These quantities are tabulated by Fisher and Yates.^ Such 
a procedure should, however, if possible, be preceded by investigation 
into the repeatability of ranks and additivity on the new scale. 

A similar problem arises in experiments, partieularly in food tech- 
nology, on the effect of treatments on preferences for foods produced 
under different treatments. A common procedure is to ask a number 
of individuals (tasters) to give the product a rating between, say, 1 
and 10. The resulting experimental data are obviously not susceptible 
to treatment by the analysis of variance without some a priori informa- 
tion about the statistical behavior of actual ratings and possibly a 
transformation. The a priori information on ratings by tasters which 
is necessary appears to be the same essentially as that required when 
we use any measuring device. When we use a measuring device such 
as a foot rule, we know that the rule we are using has been calibrated 
according to some standard and that it varies little over the range of 
environmental conditions for which we use it. We also know that, 
given an arbitrary measuring device, we can calibrate.it according to 
some standard device. It might be desirable to obtain scores for each 
rating such that the variation due to the interaction of test materials 
with tasters is a minimum relative to the variation over repetitions. 
These scores would then have some properties of additivity. There 


158 THE VALIDITY OF ANALYSES OF RANDOMIZED EXPERIMENTS 


are many problems in this field which are essentially untouched so far. 
An example of a similar technique was first given by Fisher.” 

A final remark should be made. It is general experience that fre- 
quently it is very difficult to decide which transformation, if any, should 
be used and that under these circumstances the general conclusions are 
often little affected by the choice. This should not, however, be con- 
strued as a recommendation to ignore the whole problem. 


8.6 AN EXAMPLE FOR THE READER 


The data in Table 8.5 were obtained in an investigation of 2 grass 
mixtures (H and C), at 4 rates of application. The characteristic of 


TABLE 8.5 Grass EXPERIMENT: Counts OF PLANTS PER SQUARE YARD 


T'reatment Replicate I Treatment Replicate II 
Hi 94, 53, 57 H; 431, 540, 551 
C3 371, 397, 295 Cs 180, 90, 120 
Hi, 604, 1890, 1570 Hs 404, 350, 234 
€, 25, 11, 18 C3 332, 44, 150 
C, 865, 690, 1120 C, 910, 880, 560 
Ce 90, 59, 103 01 29, 11, 21 
He 303, 271, 134 Hz 297, 199, 123 
H; 730, 261, 243 Hı 88, 81, 56 


interest was the number of plants after a certain interval, and this was 
measured on 3 random samples of 1 square yard in each plot. The 
data are given in the table, and obviously a transformation is neces- 
sary. The rates of seeding denoted by 1, 2, 3, and 4 were in fact 1, 4, 
16, and 64 seeds per unit area. 


8.7 THE ANALYSIS OF COVARIANCE 


In Chapter 6 we considered the addition of a concomitant variable 
to the linear hypothesis for a 2-way classification and gave the test 
that may be used. 

The relationship of this material to that of the previous sections of 
the present chapter must be considered. We have adopted the cri- 
terion that the experiment be capable of giving estimates of the plot 
errors to which treatment comparisons are subject, and this amounted 
to the criterion that the expectation of the treatment mean square 
should equal the expectation of the error mean square (cf. Yates *). 
The expectation in these cases was taken over the possible randomiza- . 
tions of treatments that we -ould apply. The notion behind this is 
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that an observed treatment comparison will be subject to errors be- 
cause the treatments fell on some plots rather than on others, and the 
error of a treatment comparison is the deviation of what we actually 
observe from what we would have observed had it been possible to 
apply every treatment to every experimental unit. As far as estima- 
tion is concerned then, we visualize the experiment we have as à ran- 
dom one of a population, and we wish to estimate the deviation of this 
experiment from the whole population, the whole population estimat- 
ing comparisons perfectly. It we can assume additivity, we have seen 
that the problem is solved, and the solution appears to be satisfactory. 
When we utilize the analysis of covariance, we cannot adopt similar 
reasoning and therefore rely entirely on the validity of the model 


yi = BA bi + + 8x + ei (28) 
where 
yij = the observed yield 
u = a constant 
b; = the block effect 
xij = the concomitant variable . 
eij = the error, these being normally and independently 
distributed with mean zero and variance o” 


and 
6 = a regression coefficient 


This model is very reasonable under some circumstances. For instance, 
if a plot yielded a known amount z;; in the previous year, it is reason- 
able to assume that its yield in the present year will be equal to a con- 
stant plus 8z;; plus an error with the stated distributional properties. 
The advantage of using the above model is that we achieve greater ac- 
curacy in the comparison of treatments. ; 

In the case when we use "arbitrary corrections" (Fisher, pp. 178- 
179), we do not incur the difficulties of the assumptions of the normal 
law or infinite model above, if we are reasonably sure that the corrected 
observation is additive. 

Our reason for making this remark is that, without the concomitant 
variable, we do not rely on the accuracy of a model for the test of the 
hypothesis that there are no treatment effects, whereas for the analysis 
of covariance we are entirely dependent on the accuracy of the model 
given above. 

For this reason the analysis of covariance is less useful than one might 
at first think. If, for example, we have performed a randomized ex- 
periment on a field erop and have made plant counts also, it is danger- 
ous to regard the information on plant counts as being a concomitant 
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variable and adjust the yields on the basis of the analysis of covariance. 
Even if a test of significance of the effect of treatments on plant count 
indicates non-significance, we cannot be sure that the concomitant vari- 
able is unaffected by the treatments. For this reason the analysis of 
covariance as a means of increasing precision of treatment comparisons 
should be confined to cases where the experimenter is sure that the vari- 
ations in the concomitant variable are unrelated to treatments. If the 
concomitant variable is observed before the experiment commenced, 
this condition is certainly satisfied. 

The same type of reasoning is involved in tests of significance of 
treatment effects when there are missing data. 

In other cases even when there are treatment effects on the concomi- 
tant variate, we may be interested in the effect of treatments on yield 
keeping the concomitant variate constant: for example, the effect on 
yield keeping number of plants constant in an agronomic experiment. 
In making this type of inference, we are dependent on the assumption 
that the effect of treatments on the concomitant variable is given by a 
linear regression on that variate. The validity of inferences made by 
the analysis of covariance is discussed by Bartlett. 


88 A TEST FOR ADDITIVITY 


We have found that additivity is very important in the interpreta- 


tion of experimental data, for, in the absence of additivity, the model 
should be written 


Vi = u + bi t lj + (Dti + eij (29) 
In this case the error mean square will contain terms in (bt);; which 
may or may not be random variables, depending on the inference to 
be made. Even if they are assumed to be random variables, the error 
sum of squares may not be homogeneous, and the error mean square 
may not be applied to all treatment comparisons. 

Tukey * has devised a test for non-additivity. The procedure is to 
obtain a sum of squares with one degree of freedom which will tend to 
be inflated if there is non-additivity. This test is obtained in terms oí 
the infinite model. 


The sum of squares for the one degree of freedom is 


[E mw: - . 0 — v 


[z (yi. — vy] [z 66 — »»] 
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This sum of squares may be tested against the residual mean square 
after it is deducted from the error sum of squares. The example given 
by Tukey is as follows: 


and the analysis of variance is found in Table 8.6. 


Tann 8.6 
Sum of Mean 
Due to df Squares Square 
Rows 2 24.5 12.2 
Columns 3 46.9 15.6 
Non-additivity 1 50.9 50.9 
Balance 5 33.9 6.8 
Total 11 156.2 


The one degree of freedom has a sum of squares which is significant 
by the F test at the 5 percent level. The reader is referred to Tukey’s 
paper for a detailed discussion of the test. 
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CHAPTER 9 


Randomized Blocks 


9.1 INTRODUCTION 


In presenting the various experimental patterns, it is convenient to 
consider first the basie designs, and then to examine the problems of 
choice of experimental unit. The latter will be discussed in Chapter 11, 
together with details of experimental technique for partieular types of 
experiments, such as field experiments and animal experiments. The 
basic designs are randomized blocks and Latin squares. We have al- 
ready discussed in some detail the nature of the inference in randomized 
blocks. In this chapter we shall give an account of the uses of the ran- 
domized block design and its analysis. 

Throughout this book we shall use the term “experimental unit” to 
denote the unit that is allocated a treatment independently of the other 
units. The experimental unit can contain several observational units; 
for instance, a class of students that receive a certain method of teach- 
ing in common can be an experimental unit, while the individual stu- 
dents are observational units. The distinction is, as we shall see, very 
important, because, from the point of view of inference on the effects of 
treatments, the experimental unit must be considered as a whole, and 
the variation between the observational units within an experimental 
unit is usually of little value in assessing the errors of estimates of treat- 
ment effects. 

We shall suppose then that we have determined our experimental unit 
and wish to compare “treatments. Suppose also that we decide to sub- 
ject r experimental units to each of the ¢ treatments. One possibility is 
to allocate the ¢ treatments at random to the total of rt experimental 
units, with the restriction that each treatment is applied to r of the 
units, This we may refer to as complete randomization, or randomiza- 
tion with no restrictions. Another possibility is to divide the rt experi- 
mental units into r sets of £ units, in such a way that the sets are as 
homogeneous as possible and that differences among the experimental 
units are accounted for as much as possible by differences between the 
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sets. This is an ideal requirement which can be achieved only to a lim- 
ited extent in any particular case. 

For example, suppose the experimental unit is a cow and that we wish 
to compare 5 treatments and decide to test each treatment on 4 cows. 
Suppose, furthermore, that we are interested in the effect of the treat- 
ments on yield of milk. "This particular example is chosen because quite 
a lot is known about the factors influencing milk production. We there- 
fore require 20 cows in order to perform the experiment. The experi- 
ment with complete randomization would consist of the division at ran- 
dom of the 20 cows into 5 sets of 4 cows and the allocation of the treat- 
ments to the sets at random. "To visualize how good such a procedure 
is, we have to consider the sort of data we shall obtain and the model 
of variation we may suppose the observations to follow. 

We saw in the previous chapters that we could represent the model by 


Wi Rite; 1 l, „5 
12154 


where the e;;’s have the same variance and are uncorrelated. Any con- 
trast among the treatment constants, i.e., a treatment comparison, say, 


ZA; = Mli Alo + Asta + Agta + Nils 
where DA; = 0, is best estimated by 


Ayi. + Ay. + Asya. + Mya. + AsYs- 


4 
where y;. = 4 x Vij- 


j=l 


Furthermore, the variance of this estimate with this design is 
e 
M— 
e 


where c? may be regarded as the variance of each yield. 

The variance c? is estimated by the variance between cows having the 
same treatment and is a measure of the extent to which animals sub- 
jected to the same treatment give different yields. The information pro- 
vided by the experiment on any treatment comparison (which is the 
reciprocal of the variance) is inversely proportional to the variance “. 
If we know anything at all about cows and their ability to produce milk, 
we shall know relationships between attributes of the cow and her yield- 
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ing ability. For instance we know definitely that yield depends on the 
following attributes to an appreciable extent: 


1. Breed of cow. 

2. Age of cow: the relation between lactation number and age is usually 
quite close. 

3. Stage within lactation: milk yield is known to be related to time 
from parturition, and the relationship is known to a greater or less de- 
gree of accuracy. : 


We could continue for some time to list factors affecting milk produc- 
tion, but the above are quite sufficient for purposes of illustration. Now 
suppose we have available for the experiment 10 Guernsey cows and 10 
Holsteins, 2 breeds that we know to differ considerably in their yield, 
and suppose that in all other respects the cows are more or less similar. 
With complete randomization we allow of the possibility of unequal 
numbers of the 2 breeds being subjected to the 5 treatments. The 
measure c? of the extent to which cows receiving the same treatment 
give different yields will then include a component due to the breed 
difference. We can in any particular instance, assuming a certain defi- 
nite difference between the breeds, obtain the contribution to c? which 
arises from our allowing the following possibilities to happen: (a) all 4 
cows receiving a treatment are of the same breed, (b) 3 are of one breed, 
(c) 2 are of one breed and 2 of the other. There is little point in stating 
this more precisely or evaluating the contribution: It is sufficient to 
know that the contribution may be large, relative to the variance be- 
tween cows of the same breed. The experimenter would then be ignor- 
ing valuable a priori information by using complete randomization. 
Furthermore, he would allow the possibility arising of particular treat- 
ment comparisons he wishes to make being affected by breed differences 
which he does not know precisely. A general term for such a situation is 
confounding: A treatment comparison will be subject by chance to a 
greater or lesser degree of confounding with breed differences. If, for 
example, the experimenter wished to compare treatment 1 with treat- 
ment 2, i.e., estimate the difference of the yields under treatment 1 and 
treatment 2, it would happen with a particular frequency, if complete 
randomization is used, that all the cows receiving treatment 1 were 
Holsteins and all receiving treatment 2 were Guernseys. In this case 
we would say that the comparison of treatments 1 and 2 was confounded 
completely with the breed difference. At the other extreme, it could 
happen that, for both treatments 1 and 2, two of the cows are of each 
breed, and then the treatment difference would be unconfounded with 


breed difference. 
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In passing it should be noted that there is no bias in the complete 
randomization plan. Bias is defined in terms of what would happen 
with a large number of repetitions of the experiment, and it is easily 
seen that, on the average of all possible randomizations, the treatment 
difference will not be affected by the breed difference. 

As a first modification on the plan of complete randomization then, 
we would divide the cows into 2 groups of 10 according to breed and 
within each group of 10 apply the 5 treatments each to 2 cows at random. 
Any treatment comparisons will then be comparisons between cows of 
the same breed, and the variance c? will measure the extent to which 
cows of the same breed give different yields under the same treatment. 
The variance g? under this plan will be no larger than under complete 
randomization and, if the breed difference is large, will be considerably 
less. To continue further with this example, we will suppose that all 
the cows are at approximately the same stage of the lactation period, 
for differences in stage of lactation have such a large effect on yield that, 
if this factor is not controlled, the experimental results are likely to be 
of little value. 

Finally to bring in the other factor mentioned, age or lactation num- 
ber, we will suppose that 5 of the cows of each breed are in their second 
lactation and 5 in their third lactation. We can prevent the lactation 
number from introducing variability into treatment comparisons by 
further dividing each group of 10 cows into 2 groups of 5 cows according 
to lactation number, so that we finally have 4 groups of 5 cows: (1) 
Guernsey second lactation, (2) Guernsey third lactation, (3) Holstein 
second lactation, (4) Holstein third lactation. The experimental plan 
would then be to apply the 5 treatments at random within each of the 
4 groups or replicates. This plan is known as randomized blocks of 6 
plots. Each block of 5 plots is called a replicate. 

In the previous chapter we discussed difficulties in the analysis of 
variance of the randomized block test, and these should be borne in 
mind in the setting up of the design. The two crucial points that we 
found were (a) that the treatments be additive in their effects and (b) 
that the units within the block be subject to the same variance. If we 
knew that a was satisfied for a particular experiment, we would know a 
lot about the experimental material, and there might not be the need 
for the experiment. It is usual, however, that we can obtain a good 
idea of whether additivity would hold on some scale, and we should 
work only within sets of experimental units for which this is likely to 
hold. Likewise, as far as b is concerned, we should attempt to use 
blocks or replicates that are likely to have much the same variability 
between plots within them. 
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Before the analysis of such an experiment is described, the general 
principles utilized in its construction will be emphasized. The charac- 
teristie that is to be observed is known to be affected by many factors, 
some of which have large effects, and, in addition, by many unknown 
factors. The factors that are known to have an effect fall with a par- 
ticular situation of the experimenter into two groups: those he can con- 
trol easily and those he cannot. The procedure is to decide which fac- 
tors shall be actually controlled by making up groups or blocks homo- 
geneous for these factors, and to control all other factors by the device 
of randomization. Of course, in actually controlling a factor, we do 
not achieve perfection, and the extent to which factors are not actually 
controlled is measured exactly by the variance between units treated 
alike. It would be entirely reasonable to make up the groups on the basis 
of a regression function of yield on the factors that are known to affect the 
yield. Experimental units would be sorted into groups, or what we 
usually call blocks, on the basis of their values for the regression function. 

This procedure should be carefully differentiated from a procedure 
that is superficially valid which has some vogue in the social sciences. 
In the social sciences it is difficult if not impossible to perform experi- 
ments, and the following procedure is resorted to. Suppose that it were, 
in fact, very difficult to perform our experiment on the cows, but that, 
of ‘the large number of cows in the United States, some have received 
treatment 1, some treatment 2, and so on. We know that it is useless 
merely to compare those receiving the different treatments, because they 
will differ in many respects other than the treatment. We, therefore, 
find, among our population of cows, some cows that receive each of the 
treatments but are “identical” with respect to the factors we listed 
above, namely, breed, lactation number, and stage in lactation, and we 
compare the cows receiving the various treatments. Any differences we 
observe we shall attribute to the effect of the treatments. In drawing 
such an inference with such data, we have to assume that the cows are 
identical in all respects except that they received different treatments. 
In fact, we cannot make the cows identical in the factors on the basis 
of which we select our “experimental” animals, because 2 of the 3 vari- 
ables are continuous variables. By the term breed we merely mean that 
the cows have many superficial characteristics in common, say, certain 
genes controlling, to a greater or lesser degree, color, size and conforma- 
tion, and a certain amount of common ancestry. The stage in lactation 
is a continuous variable ranging from zero to some number of months 
after parturition, and it is most unlikely that we could find 2 cows that 
gave birth to calves at the same time. It is for these reasons that we 
put the word identical above in quotes. 


168 RANDOMIZED BLOCKS 


We have the further difficulty that the "treatments" appear to be the 
ones we wish to compare, but it may and will generally be the case that 
the “treatments” were associated with other husbandry practices, and 
we would not be measuring the effect of the "treatments" only. For 
example, suppose the treatments consisted of different levels of nutri- 
tion during lactation. Dairymen who feed their cows at a high level 
of nutrition while they are in production feed them at a high level of 
nutrition throughout their lives. We would then be measuring the ef- 
fect of the treatment plus the effect of some treatment applied before 
the period of observation. In some instances inferences made in this 
way are valuable; and most of our knowledge in a field such as psychol- 
ogy is based on this type of inference. Frequently, however, we may 
obtain an entirely erroneous conclusion. In determining treatment 
effects in a true experiment, we, in fact; estimate the effect of the treat- 
ment, and any factors associated with it. But in all cases we are con- 
cerned with the possible happenings in an indefinitely large set of re- 
peated experiments. As long as the treatments are kept constant, in- 
cluding the factors associated with the treatments, we draw the correct 
inference. This point serves to emphasize the necessity of exact report- 
ing of treatments and experimental procedures. 

The randomized block design for the testing of t treatments with r 
replications consists then of the division of the total of rt experimental 
units into blocks of ¢ units, within each of which the treatments are 
applied at random. 


9.2 THE ANALYSIS OF RANDOMIZED BLOCKS 


The yields of the experiment may be arranged in an r X ¢ table 
(Table 9.1). 


Tank 9.1 
Treatment 
Block 1 2 3 t 
| yn ym ete Yi. 
2 Ys. 
3 Ys. 
r Y, 


Ta" VE Ya Ya Fá 
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The marginal totals are then obtained, and the analysis of variance 
is caleulated as in Chapter 6 (Table 9.2). 


TABLE 9.2 
Mean 
Due to df Sum of Squares Squares 
. . 
Blocks r-1 2 — —— B 
1 12 rt 
. d. z 
Treatments 1—1 ES al T 
2 „ wrt 
Error ( e =) By subtraction 
PAL 
Total rt—1 ly — — 


The mean squares are obtained by dividing the sum of squares by the 
corresponding degrees of freedom. The test of the null hypothesis that 
the treatments have no effect, i.e., that the treatment constants are 
equal, is to compare the observed variance ratio 1/ E with the tabulated 
values of the F distribution with (t — 1) and (r — 1)(t — 1) degrees of 
freedom. 

The results of such an experiment are simply presentable in the form: 


Treatment Mean 


Y. 
1 EL 
= 
V. 2 
3 T E 
d — 
. | r 
A 
t zi 
r 


The estimated standard error of each mean is V E/r for the comparison 
of means, and any treatment comparison 

Dit, with ZA; = 0 
is estimated by 


Y, 
ge 
r 


with an estimated standard error of V/ZX;V E/r. In order to test 
whether this comparison takes on a particular prechosen value, say, c, 
we evaluate Student's t equal to 


* 
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NF. /r — c (1) 
VIN VE/r 


and compare this observed value with tabulated values of the ¢ distri- 

bution with (r — 1)(¢ — 1) degrees of freedom, the number of degrees 

of freedom on which the estimate Æ of the error variance is based. 
Confidence limits on the value of the comparison are given by 


Y; E 
IM E an Y 2d”; ur (2) 


) 
where tp r-1)4-1) is the value of ¢ for the probability p with degrees of 
freedom (r — 1)(t — 1). 

We note that, from the point of view of restricted sampling, the 
variance of a treatment mean for comparison with outside data is 
a*(t — 1)/rt which is estimated by E(t — 1)/rt. 


9.3 BREAKDOWN OF THE TREATMENT SUM OF 
SQUARES 


The experimenter may wish to test various hypotheses about the 
treatments. Any comparison that he had a prior basis for testing may 
be tested in the above way. Frequently a partitioning of the treatment 
sum of squares is desirable. In the extreme case, it may be desirable to 
obtain an orthogonal set of (f — 1) treatment comparisons. An orthog- 
onal set may be denoted by 


D ait, * 1, 2, „ — 1 
7 
where, for each k, LN, = 0, and, for each k and ! with k x 1, 
j 
2 NIN, = 0 
j 


For example, a set of orthogonal comparisons for 4 treatments is the 
following: 


41 ＋ 2 — 3 — (4 
1 — z T 4 — . 
4 — 2 — 3 ＋ . 


The stated properties should be verified. The particular set of orthog- 
onal treatment comparisons to be used depends entirely on the hypoth- 
esis the experimenter wishes to test; i.e., they can be specified only by 
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the experimenter or by someone with knowledge of the experimental 
material and treatments. 
The estimate with the randomized block design and no missing data 


of any comparison 
y»? (3) 
J 


Y; 
Y Mj < (4) 


and the corresponding sum of squares with one degree of freedom is 


GT o 


A partitioning of the sum of squares which is frequently desirable is 
the following: Suppose the treatments form k groups (1, , p), (p + 1, 

„ p +q), ete. The total sum of squares for treatments would then 
be broken down into 


Between groups (k — 1) 

Within group 1 (p—1) 

Within group 2 (q — 1) 
etc. 


‘The sum of squares between groups will be obtained in the usual way, 
namely, that, if pr plots make up the first group, gr make up the second, 
and so on, it is equal to 
Total of group 1)? total of group 2)? Y?.. 
( . ( . 
pr qr rt 


The sum of squares within a group, say, the first, will be 


Yu e . Yo+---+¥-9)? 
r r r pr 
and so on. 


In testing several components of a treatment sum of squares by com- 
paring each with the same error mean square by F tests, it should be 
remembered that the F tests are not independent, because the same de- 
nominator is used in all the tests. The degree of correlation decreases 
as the number of degrees of freedom on which the error mean square is 
based increases. (See Finney ' for further discussion on the normal 


theory or infinite model.) 
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9.4 RANDOMIZATION TEST 


We are basing our conclusions on randomization tests, as discussed in 
the previous two chapters. Perhaps, however, we should emphasize that, 
although the approach we adopt appears to be that of an infinite model, 
we have justified this method by reference to randomization tests. The 
relation of the randomization test to the corresponding F test was indi- 
cated in Chapter 8, by obtaining moments of the criterion (treatment 
mean square/error mean square) over the population of randomizations. 
These moments werg found to be close to those of the theoretical F dis- 
tribution, This is not, of course, a perfect proof of the correspondence, 
for we are not particularly interested in the correspondence over the 
bulk of the distribution, but in the upper tail; also we know little of the 
rate of approach of the randomization distribution to the F distribution 
with increasing size of experiment. 


9.5 THE TREATMENT OF RANDOMIZED BLOCK 
EXPERIMENTS WITH MISSING DATA 


Let us suppose, for purposes of illustration, that the observation for 
treatment 1 in block 1 is missing. The procedure is to substitute a 
symbol z, say, for the missing observation and perform the analysis of 
variance. This will be as in Table 9.3, where 


Y^. = now the total for the (¢ — 1) plots in block 1 for which yields 
were obtained 


Y’., = the total of the (r — 1) plots of treatment 1 for which yields 
were obtained 


and 
Y'.. = the total of the observed yields 


TABLE 9.3 ALGEBRAIC ANALYSIS OF VARIANCE 


Due to Sum of Squares 
Blocks Uv par eg Le LO + 
t t t rt 
, 2 y: " 
Treatments * ee eee eee hai a 
r r r rt 
Error By subtraction 
7 1 
Total 27 K r- Tm 


The error sum of squares is then 
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3 Ob z? (¥4.+2)? (¥'.+2)? y : 
2 + L———— — -— ET + terms not involving x. 


This sum of squares is now to be minimized for variation in z, and 
this is simply done by equating the differential with regard to x to zero 
and solving for 2: i.e., 

MEET S C un 
T t r 


~ 


1 1-4 Ei E At 
20 Aree pate is ) 1 
r r 


0 


giving 


or 


RRAC B e 
The quantity z is the best estimate of the yield of the missing plot under 
the model. This value for z may then be inserted in the original table 
of yields, the marginal means of the augmented table give the block and 
treatment means, and comparisons of treatments are obtainable directly 
by taking the same comparison of the treatment means from the aug- 
mented table. 

An approximate test of significance of the null hypothesis that the 
treatments have no differential effects may be obtained by analyzing the 
augmented table in the usual way, with the modification that the de- 
grees of freedom for the error sum of squares is diminished by the num- 
ber of plots for which observations are missing (in this case, 1). This 
test can be shown to be biased in that the expectation of the treatment 
mean square is greater than the expectation of the error mean square 
under the null hypothesis. If the approximate test of significance indi- 
cates that there are no significant treatment differences, there is no need 
to perform the accurate test of significance. 

The accurate test of significance in the above case is made by the 
analysis of variance given in Table 9.4. (This test is accurate on the 


TABLE 9.4 ANALYSIS OF VARIANCE FOR Exact TEST oF SIGNIFICANCE 


Due to df Sum of Squares Mean Square 
i EE Pag De 
mois zn nEPA 98 t n-i 
Treatments t-l By subtraction 
Error (r-nt-1-1 An in the analysis of variance of the 
augmented table 
———— 
r?.. 


Total "-2 XU 3 
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basis of normal law theory.) Mean squares are then compared by the 
F distribution in the usual way. 

The extensions of this procedure to cases where more than 1 plot is 
missing will not be given. The reader may find it instructive to work 
through a simple case with more than one missing observation. A some- 
what involved case is described by Yates.? 

A simple method when there are several missing observations is to 
replace each missing observation by the mean of the block in which it 
lies, as a first approximation. The formula for 1 missing plot is then 
used to estimate a second approximation for the missing observations 
in order, utilizing either the block mean or the new approximation, if it 
has been obtained for all missing plots except the one being estimated. 
Such a procedure converges rapidly, in general. 

Either of these procedures is valid as long as each block and treat- 
ment is represented at least once in the table of observed yields. If the 
whole of a block or of a treatment is missing, the experiment is regarded 
and treated as an experiment of correspondingly reduced size. If only 
1 treatment is represented in a block, the block is omitted as the 1 plot 
gives no information on treatment differences, 

In some situations, when the number of missing plots is large, it is 
computationally simpler to follow the standard methods for the 2-way 
classification outlined in Chapter 6. 


9.6 THE VARIANCE OF TREATMENT COMPARISONS WITH 
MISSING PLOTS 


In a randomized block experiment with ¢ treatments and r blocks, 
where no plots are missing, the variance of a treatment mean for com- 
parisons with other treatment means has been shown to be c?/r, where 
c? is estimated by the mean square for error in the analysis of variance. 

When a single plot is missing, the treatment mean containing an esti- 

mated yield is a simple linear function of known yields; i.e., if the plot 
, corresponding to the kth treatment and the lth block (yx) is missing, 
then it has been shown that the best estimate of the yield for that plot is 


2 tT", + rB', — 7 
(r - )(t- 1) 


where T", is the sum of all known yields for plots receiving treatment k, 
B is the sum of all the known yields from plots in block J, and 7" is 
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the sum of all known yields. The estimate of the kth treatment mean 
is then 
tT’, + rB’, — -] 
(r — 1)(t — 1) 
Using the fact that the % are distributed with common variance c? 
and that the variance of 


1 1 
îs =- (T's + 2) -Ln 
r r 


Du 


is o Ni (apart from covariance terms which vanish in any comparison 
orthogonal to blocks as diseussed in Chapter 8), we find that 


vnd) = [re 
à f+] 


The variance of any other treatment mean is, as above, c?/r, and the 
treatment means are (in a sense) uncorrelated. For any contrast among 
the treatment means, í 


Eri wth D =0 
i=l 


the variance of the contrast is 


"ys ＋ fh] ^ 
r 7 (r 106 — 1) 

If 2 plot yields are missing, the variance of any contrast among treat- 
ment means may be found by expressing the contrast as a linear func- 
tion of all the known plots, the variance of which is easily evaluated. 
As the number of missing plots increases beyond 2, the algebra involved 
in such calculations becomes extremely tedious and not worth while, 
and it is probably best if accurate variances and covariances are needed 
to have recourse to the methóds of Chapter 6 for the 2-way classifica- 
tion with unequal numbers. 

Yates? sets upper and lower limits on the variance of the difference 
of 2 treatment means by ignoring the block classification altogether to 
get a lower limit and by rejecting all those blocks that do not contain 
both treatments to set the upper limit. He also proposed the approxi- 
mate rule of giving 14 weight to each plot of a treatment that has no 
corresponding plot in the same block belonging to the other treatment. 
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For example, suppose we had treatments a, b, c, d, e in 6 blocks as shown 
in Figure 7, where the shaded plots are missing. 


'The rule in comparing 2 treatments a and b is: 


If a and b both occur in a block, give each a weight of 1. 

If a occurs without b in a block, give a weight of 14. 

If b occurs without a in a block, give b weight of V4. 

If both a and b do not occur in a block, give each a weight of 0. 


Thay var (l. — b) = $ + pe? 


1 1 
dit; 4 -(3 6). 
( ) 5 + 8 
var (f — f.) = ($ + pe 
When data are missing, an easy partitioning of the treatment sum of 
squares is no longer possible, since the effects due to each factor are no 
longer independent of the order in which they are estimated. This is a 


consequence of the non-orthogonality of the data, and reference should 
be made to Chapter 6 for the treatment of such a situation. 


9.7 DIFFICULTIES OF RANDOMIZED BLOCKS 


We may summarize the relevant discussion of the previous chapter in 
stating that the following difficulties of randomized block experiments 
are fairly common: 


1. Missing data: procedures for this problem are given above. 
2. Heterogeneity of Errors: this may be of two types: 
(a) That the variance of the experimental errors is related to the 
expected yields because of non-additivity, or differential variability from 
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block to block. In this case the appropriate procedure is to use a trans- 
formation, which results in error variance being independent of expected 
yield, and to apply Tukey's test for non-additivity. 

(b) That the error variance of some treatment comparisons is 
greater than that for other comparisons because of non-additivity, or 
sampling errors within the plot, if sampling is used. It is an advantage 
of randomized blocks that an error variance may be obtained for each 
treatment comparison. This is done by evaluating the comparison in 
each block and estimating the variance of the mean comparison by the 
sum of squares between the values for each block divided by the number 
of blocks minus one, and by the number of blocks. 


9.8 THE PURPOSES OF REPLICATION 


In any randomized block experiment it is necessary to have at least 
two replications in order that an estimate of the experimental error vari- 
ance may be obtained. With increasing replication the error variance 
will be estimated with increasing accuracy, the estimated error variance 
being subject to a standard error of approximately 


c 

Ne 
where c? is the true value and n, is the number of degrees of freedom on 
which the error is based, according to the infinite model. In general, it 
will be expected, and it is assumed in the analysis, that the true value 
of the error variance does not depend on the number of replicates, since 
it measures the variation within replicates if the treatments are identical. 

The important purpose of replication is, however, to decrease the error 
of treatment comparisons. The true variance of any treatment com- 
parison was shown earlier to be proportional to /r, where a? is the 
variance per plot and r is the number of replicates. This variance de- 
creases directly with increasing 7, and the information on the comparison 
which is proportional to r/o” increases proportionally with r. 

It is intuitively obvious that increasing replication results in increas- 
ing sensitivity of the experiment. We shall devote a chapter later to 
this subject. For the moment we shall consider a simple aspect of the 
problem, originally discussed by Neyman et al? We suppose that we 
are comparing 2 treatments, A and B, and wish to test the hypothesis 
that B gives greater yields than A. We suppose that the infinite model 
can be used so that we obtain an estimate d of the difference B — A, 
with an estimate of error & based on n degrees of freedom, the estimate 
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d being normally distributed around the true value A with variance c?;, 
and the estimate of variance s? being distributed independently of d as 
2 
zx X (n) 


With this formulation the test of the hypothesis A > 0 will be the ¢ test 
with n degrees of freedom and level of significance equal to twice the 
corresponding tabular level. The probability of concluding on the basis 
of this test that A is not greater than zero is easily obtained by integra- 
tion of the joint probability density of d and s?. From tables given by 
Neyman we have constructed the relations given in Table 9.5 between 
number of replicates r and probability of rejecting the null hypothesis 
for various values of A/, ø being the standard deviation, with random- 
ized blocks of 2 plots. 


Tasty 9.5 Sensrriviry or EXPERIMENTS IN Ranvomizep BLocks or 2 Prors 


Ajo 
r 1 ‘2 3 
Probability of Rejecting Null Hypothesis with a 1% Test (Approximate) 

2 0.03 0.05 0.08 
3 0.05 0.13 0.25 
4 0.09 0.27 0.53 
5 0.13 0.42 0.77 
6 0.16 0.57 0.92 
7 0.20 0.74 0.96 
8 0.24 0.81 0.99 
9 0.20 0.86 

10 0.36 0.91 

16 0.00 0.99 

32 0.81 

44 0.99 

Probability of Rejecting Null Hypothesis with a 5% Test (Approzimate) 

2 0.14 0.25 0.36 
3 0.22 0.49 0.74 
4 0.30 0.60 0.02 
5 0.38 0.82 0.99 
6 0.45 0.88 
7 0.51 0.94 

8 0.56 0.07 

9 0.61 

10 0.65 

16 0.84 

32 0.99 
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This table emphasizes the importance of replication, for the experi- 
menter should have in mind the magnitude of true differenees which 
will be shown with high probability by the experiment to be significant. 
Thus, the experimenter should be in the position of being able to state 
that, if the true difference is x units, he wants a probability of 95 percent 
that the experiment he will do will indicate that there is a difference. 
If, for example, A/s = 1 and a 5 percent test is to be used, then about 
23 replicates are necessary for the probability to be 95 percent of de- 
ciding on the basis of the test that there is a difference. The above dis- 
cussion indicates the importance of making the quantity A/s as large 
as possible. This may be done either by reducing g or by increasing A 
or by both. The increasing of A is much a matter of experimental tech- 
nique and may not be possible without some redefinition of the problem. 
An example in which this has been used is in biological assay where the 
problem is to estimate the effects of diff rent proteins on growth of rats, 
and.the technique is to reduce the animals to a very low plane of nutri- 
tion with consequent magnification of A over what would have been 
obtained with ordinary animals. The reduction of c? is one of the prime 
problems of experimental design, and we shall see the development of 
various experimental patterns devised to remove variation between ex- 
perimental units treated differently. 
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After the experiment has been conducted, information additional to 
yield may be obtained, or there may have been obvious simple positional 
effects in the experiment. It may then be desirable to take account of 
this concomitant variation. For example, in a plant experiment, it may 
happen that, for no reason related to the treatment, there resulted vari- 
ation in number of plants per plot. If the experimenter is sure that this 
variation is not related to treatments, the effect of the concomitant vari- 
ation may be removed by the analysis of covariance. Again, in a green- 
house experiment, it may be thought that variation in light due to differ- 
ing distances of the experimental units from the side of the greenhouse 
may have produced some variation in the yield and that such variation 
is in no way related to treatment. The experimenter is then at liberty 
to treat the distance of the unit from the side of the greenhouse as a 
concomitant variable and to use the analysis of covariance. The only 
purpose of using such information is to increase the accuracy of treat- 
ment comparisons, and whether this result is achieved may be deter- 
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mined by testing the error regression of the yield on the concomitant 
variable for significance. If it is not significant, it will not be worth 
while to make the adjustments. : 

In accordance with the discussion of the previous chapter, the infer- 
ence on the unadjusted yields is based on randomization considerations, 
while the inference on the adjusted yields is based on the assumption 
of the model 

Vij = u + bi + lj + Br + eu (8) 


where 2; is the concomitant variable, and the e;;’s are normally and 
independently distributed. "The additional information which the co- 
variance analysis gives is, therefore, obtained at the cost of this assump- 
tion, and it is necessary to be sure that the variation in the concomitant 
variable has not arisen as a result of the treatments. In the case of posi- 
tional effects, the experimenter is fairly safe in using the procedure. In 
the case of a concomitant variable like number of plants, however, such 
an assumption may not be acceptable. 

In such instances we may wish to determine the effect of treatment on 
yields, supposing plant number were kept constant, and, for this type 
of inference, the analysis of covariance is satisfactory, providing again 
that the model is reasonably satisfied. In some cases, for example, one 
Re use as the concomitant variable some function of the plant num- 

TS. 


9.10 THE EFFICIENCY OF RANDOMIZED BLOCKS 


In a field experiment, there is generally no difficulty in arranging the 
testing of the ¢ treatments in r blocks of £ plots. In other experimental 
situations, there may be some difficulty in arranging the experimental 
units in groups of ¢ units, each group forming a block. It is desirable, 
therefore, to investigate the efficiency of the arrangement in randomized 
blocks relative to the complete randomization arrangement. The word 
ATUS as used here and elsewhere refers to the efficiency of esti- 
mates. 

The best method by which this may be done is to have available 
so-called uniformity trial data: that is, data obtained on a large number 
of experimental units with a common treatment. These are then di- 
vided into sets of rt units, each set simulating the actual experiment to 
be done, and each set being divided into r blocks of ¢ units, according 
to some known information about the experimental units. For example, 
if the experimental unit is a cow, the cows may be arranged in blocks 
on the basis of breed, age, stage in lactation, and so on. An analysis 
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of the consequent observations is then made with the result shown in 
Table 9.6, supposing there are k sets of rt units. 


TABLE 9.6 
Mean 
Due to df Square 
Sets k—1 
Blocks within sets k(r — 1) B 
Within blocks kr(t — 1) E 
Total krt — 1 


The mean square E is then an estimate of the experimental error c? 
with randomized blocks of ¢ plots, and B is an estimate of the variance 
between blocks within the experiment. 

We can then say that the analysis for a single experiment with dummy 
treatments will be as shown in Table 9.7. 


Taste 9.7 
Due to df Sum of Squares 
Blocks 1 —1 (r— 0B 
Within blocks r(t — 1) r(t — DE 
"Total 7 — 1 (r = 1)B + r(t — DE 


If the blocks were not used, the variances of treatment comparisons 
would be proportional to the total mean square, i.e., to 


(r —1)B + r(t — DE 
11 — 1 


whereas with the blocks they are proportional to E. The relative effi- 
ciency of randomized blocks to complete randomization is then 


(r—- DB-4 r(t— DE 
(rt — 1)E 


In general, B will be greater than E unless the blocks are entirely inef- 
fective in removing heterogeneity, so that the relative efficiency of ran- 
domized blocks is greater than or equal to 100 percent. 

The field experimenter. will almost invariably use blocks, so that the 
question is for him somewhat academic. When confounding, which will 
be discussed in a later chapter, is used, however, it is of interest even for 
field experiments. With confounding the size of the block will be less 
than the number of treatments, and this results in a loss of information 


(9) 
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on eonfounded comparisons. It is important to estimate whether the 
gain in information on the unconfounded comparisons, which results 
from the smaller size of block, outweighs the loss in information on the 
confounded comparisons. 

In the general type of experiment, the above method may be used to 
determine how much information or efficiency is gained by controlling 
on particular extraneous factors: that is, holding these constant to a 
particular degree. For example, how important is it that observations 
on industrial articles produced under different treatments be made under 
environmental conditions held constant in a particular respect? It was 
stated earlier that the essence of experimentation is the controlling of 
extraneous factors easy to control, and randomization over all other 
factors. This process is put on an economic basis by considerations of 
efficiency of arrangements in blocks made up in particular ways; i.e., we 
wish to maximize efficiency by variation in size and shape of blocks and 
number of characteristics controlled for a fixed or minimum cost. 

It is possible with any experiment laid out with certain restrictions 
on the location of treatments to estimate how much information would 
have been lost by using a smaller number of restrictions. For example, 
with an experiment of r blocks of ¢ plots testing ¢ treatments, it is pos- 
sible to estimate what the relative efficiency of an arrangement with no 
blocks would be. It will, in fact, be 


(rt — 1)E 
(r - DB + r(t — DE 


where E is the error mean square and B is the block mean square. 

The reader should note that the argument used in obtaining the rela- 
tive efficiency of randomized blocks is exactly the same as that used in 
Chapter 8 and is based on the finite model, Instead of being within 
blocks, the randomization is within the total set of rt plots. To verify 
the formula for the relative efficiency, we note that, with complete 
randomization, 


1 
5% = 1 with probability — 
r 


A : ZI 
and, if 0 = 1, then ay = 1, with probability 21 (i“, J) * (i, j). 
ri — 
The plot yields y;; are given by 
yg = V.. + (y — y.) 
= y.. + dj (10) 
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and it is readily found that the error mean square has an expectation of 


1 * 
Lec n 
wap > = 
Now, 
di; = bi + ei (11) 


where b; and c;; are defined as in Section 8.2, and so the expectation of 
the error mean square is 

es —(: iE 2 (12) 

(rt — 1) i 7 
We found in section 8.2 that the expectation of the block mean square B 
is (Eb?;/(r — 1), and of the error mean square E is wear — 1), so 
J 
(r — 1)B + = DE 
1 1 

the result stated above. This method is not then empirical, but is in 
strict, accordance with randomization theory. The assumption behind 
the calculation is that exactly the same experimental units will be used 
in either design. In applying the formula to field plot experiments, it 
should be noted that the size and shape of plots are considered to be 
exactly identical for the two designs, and this may vitiate the calcula- 
tion to some extent, in that a different division of the total experimental 
material into plots may be desirable for the two designs. 

The above discussion is concerned with efficiency of estimation and 
not relative sensitivity. The latter depends not only on the error vari- 
ance but also on the number of degrees of freedom for error, and will be 
be discussed in Chapter 12. 


that the expectation of is o”, in accordance with 
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CHAPTER 10 


Latin Squares 


10.1 INTRODUCTION 


The randomized block type of experiment may be regarded as an 
arrangement in which treatments are randomized under one restriction: 
namely, that each treatment must occur in each block. If , for instance, 
the experimental unit is a cow, blocks may be made up of cows of the 
same lactation number. Now it is fairly obvious that this may be ex- 
tended so that the cows are divided into groups by lactation number 
and also into groups by, say, yield in previous lactation, so that each 
animal falls into one of the lactation number groups and one of the 
previous yield groups. If the numbers of groups on each of the 2 fac- 
tors are equal to, say, 4, the cows may be regarded as forming a 4 X 4 
arrangement as shown in Figure 8. 


Group on First Factor 


Ficune 8. 


It is then possible to superimpose 4 treatments on this arrangement 
so that each treatment occurs once and only once in each row of the 
plan and in each column. Such an arrangement is called a Latin square. 
These arrangements were first used in experimental agriculture in which 


the above arrangement is merely a division of the experimental area 
184 
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into k? plots. Such arrangements have fairly obvious properties, the 
important one being that any, comparison of treatments is unaffected 
by average differences which exist between the rows or between col- 
umns. Such differences will not affect the errors of treatment compari- 
sons so that such arrangements are likely to lead to greatly increased 
precision. The order in which Latin squares will be discussed is to 
present the combinatorial properties of these arrangements first and 
then to discuss the uses of these arrangements for experimental purposes. 
Some detailed discussion of the combinatorial properties is necessary, as 
these properties lead to an understanding of the randomization test 
and also to designs other than the simple Latin square. 


10.2 COMBINATORIAL PROPERTIES 


A reduced Latin square (or a Latin square in standard form) is one 
in which the first row and the first column are arranged in alphabetical 


order: e.g., 
ABCD 


B^ D 4 
C OD Ww 3B, 
DA BC: 


The number of squares that can be generated from a reduced Latin 
square by permutation of the rows, columns, and letters is (!)*. These 
are not necessarily all different. If all rows but the first and all columns 
are permuted, we generate k!(k — 1)! squares. 

We proceed to give an enumeration of the samller squares. 


10.21 3 X 3 Square 
There is only one reduced Latin square, namely: 


From this we can generate 12 squares by permuting all rows except the 
first and all columns. 
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10.2.2 4 X 4 Squares 


_ LATIN SQUARES 


There are 4 reduced Latin squares which fall into two sets as in 


"Table 10.1. 


Taste 10.1 Tae Revucep 4 X 4 LATIN Squares 


First Transformation Set 


S8 
E 
is] 

8 


A 


B 
[^] 
D 


BC 
Q.D 
DA 


AB 
(2) 


D 


Qs > 


A 


B 
[^] 
D 


Qk 9 Uu 
wo» 2 


(3) 


m wads 


Second Trans- 
formation Set 


A B 
B A 
C D 
Dc 


C 


D 
A 
B 


(4) 


D 


C 
B 
A 


One square of the transformation set may be obtained from the other 
by permutation of letters and subsequent rearrangement into reduced 


or standard form. This is the definition of a transformation set. 


For 


example, any interchange of letters and rearrangement into standard 
form of the member of the second transformation set result in its re- 
production. Thus, by interchanging A and C, we have 


0 
B 
A 
D 


B 
c 
D 
A 


A 
D 
C 
B 


D A 
A D 
— 

B «C 
Ç B 


B 
C 
D 
A 


0 
B 
A 


D 


D 


C 


A 


D 


B 
A 
D 
ley 


[^] 
D 
A 
B 


> wa YS 


In the first transformation set, square 2 can be obtained from square 1, 
for example, by interchanging A and D in 1 and rearranging, thus: 


D 
B 
C 
A 


B 


A 
0 


[^ 


D 


10.23 5 X 5 Squares 


There exist 2 transformation sets, 


A 


B 


B 


D 
A 
[^] 


[^ 
A 
B 
D 


squares and the other containing 6 


ample for each set is listed by Fisher a 


10.2.4 6 X 6 Squares 
Fisher and Yate: 


D 


B 
[^] 
A 


— 


A 


B 
[^i 
D 


B 
Cc 


C 


D 
A 
B 


D 


A 
B 
Cc 


sets, which contain a total of 9408 reduced Latin squares. 


one containing 50 reduced Latin 
reduced Latin squares. An ex- 
nd Yates.! 


s ^* list a square from each of the 22 transformation 
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10.2.5 Larger Squares 

An exhaustive enumeration of 7 X 7 squares was made by Norton.* 
Fisher and Yates! give examples of squares of sides 7, 8, 9, 10, 11, 12. 
A square of any side may be obtained by writing down the correspond- 
ing number of letters to make the first row, making the second row by 
moving the first row along one step, and putting the last letter of row 1 
in the first position in row 2, and so on. 


10.2.6 Selection of a Random Square 

'The procedure for obtaining a random square is given by Fisher and 
Yates! This consists of first selecting a reduced square at random. 
For squares of side 3, 4, or 5, permute all rows except the first and all 
columns, or all rows and all columns except the first, and assign treat- 
ments at random to the letters A, B, C, ---. For 6 X 6 squares, select 
a reduced square at random, and permute all rows and columns, and 
then assign the letters to treatments at random. For larger squares, 
it is satisfactory to take any square and permute rows, columns, and 
treatments. 

10.3 GRAECO-LATIN SQUARES 

The Graeco-Latin square properties are exemplified simply by the 
square of side 3, the only one apart from permutation of rows, columns, 
Greek letters. . 

B, C. Ag 
Cg Ay Ba 

In this arrangement every Latin letter occurs once in each row and 
once in each column, each Greek letter occurs once in each row and once 
in each column, and each Greek letter occurs once with each Latin letter. 

Graeco-Latin squares of side k exist when k isa prime number or a power 
ofaprime. They also exist for all other odd numbers. A Graeco-Latin 
square of side 12 exists. There has not been an enumeration for other cases. 


10.4 THE COMPLETELY ORTHOGONALIZED SQUARE 


As an example the square of side 4 is given in Table 10.2. 


TasLE 10.2 Tun 4 X 4 COMPLETELY ORTHOGONALIZED SQUARE 
Aia Bog Cs Da 
Ba Ass Dza Cig 
Ca Diy 4% Baa 
Dy Cia Bu Ary 
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Note that the Latin letters, the Greek letters, and the numerals have 
the Latin square property, and also that the Latin and Greek letters 
form a Graeco-Latin square, as do the Latin letters and numerals, and 
that the Greek letters and numerals have the Graeco-Latin square 
property. 

The extensions of this are given by the following theorem, due to 
Stevens * and Bose: 5 When k is a prime or a power of a prime, there 
exists a k X k square with each cell containing a letter of each of (k 1) 
languages, such that the letters of any two languages form a square with 
the Graeco-Latin square property. 

The proof of this theorem follows from the existence of Galois fields 
of p” elements where p is à prime and n is an integer. When n is unity, 
the Galois field may be represented by the numbers 0, 1, 2, .. ., (p — 1), 
where the operations of ordinary arithmetic are performed, except that 
any resulting number is replaced by the remainder when it is divided 
by p (i. e., is reduced modulo p). Let the coordinates of any cell be 
given by x and y, where æ and y each run from 0 to (p — 1). Then a 
square in each language is given by inserting in the (z, y) cell the num- 
ber x + Ay, reduced modulo p. By using values of 1, 2, . ., p — 1, for 
i, -(p — 1) different squares will be obtained, and, when superimposed, 
the squares form, as is easily proved, the completely orthogonalized 
square. 

Corresponding to the existence of a completely orthogonalized square 
of side p there exists a very useful partitioning of p? objects. Note 
that, with the 4 x 4 completely orthogonalized square, the 16 cells may 
be divided into groups of 4 in 5 ways, namely: 


By rows 

By columns 

By Latin letters 

By Greek letters \ 
By numerals 


These groupings are orthogonal in the sense that any grouping gives 4 
groups, each of 4 cells, and the 4 cells that occur in 1 group of any 
grouping lie 1 each in the 4 groups of any other grouping. It follows 
that, if the cells are occupied by p? uncorrelated random variables, any 
contrast among the groups of one grouping will be orthogonal to any 
contrast among the groups of another grouping. For example, a group 
of 4 cells according to Latin letters in the 4 X 4 example above consists 
of the cells with A which are 


1, 6, 11, 16 
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where the cells are numbered serially from left to right. The groups by 
numerals are: 
(1) 1,8,10, 15 


(2) 2,7, 9,16 
(3) 3,6, 12, 13 
(4) 4,5,11,14 


and we see that the cells containing A are distributed one each in the 
groups of numerals. 

Among 16 objects there will be 15 degrees of freedom with the usual 
analysis of variance. These 15 degrees of freedom may be broken 
down into 5 sets of 3 degrees of freedom, any set of 3 degrees of freedom 
being given by the contrast among the 4 groups according to one of the 
methods of classification. : 

In general, the (y — 1) degrees of freedom among p^" objects may 
be divided into (p^ + 1) sets of (p" — 1) degrees of freedom. This 
property is the basis for lattice square designs and is of frequent value 
in other connections. 


10.5 THE ANALYSIS OF THE LATIN SQUARE DESIGN 


We shall examine the Latin square design from the same point of 
view as that which we used for randomized blocks. "We suppose then 
that the subscripts (7, j, k) denote the row, column, and treatment of à 
particular plot. In all there are Ë possible yields, for each treatment 
can conceptually be applied to each plot, and from this population of 
true yields we draw a sample which is based on a random ¢ X ¢ Latin 
square. Such a sample has obvious properties of balance, particularly 
when we are concerned with the comparison of treatments. 

The following relation is identically true: 


Wk = Y + Qe ) T uy) 
＋ %. — Vies . HY) e = 5 
Ha Wis — Yok yet uk y . T ..) 
+ (uk — Ws — Vk — Yok H Yii HYG ＋ u ge) () 
1, J, K = 1,2, t 


Now suppose that 
yk = Tij Tk 
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where gij is the yield under a uniform treatment of plot (7j): that is, 
that treatments are additive in their effects. The relation then reduces 
to 


Vik = (T. . +7.) + (zi. — x...) + (r. j — 2.) + (rk — 7.) 


＋ (zij — ti: ., Tz.) (2) 
which we may write as 


Vit = u + pi + Yj ＋ Tk ＋ eijk (3) 


'The last term is à random variable since we have chosen a random 
t X t Latin square, and the particular (x; — z;. — x.; + z..) associated 
with 7, is therefore chosen at random. Let ôf; be the random variable 
which takes the-value unity if treatment k is on the plot (7, j) and is 
zero otherwise. The joint distribution of the 6f’s is determined by the 
particular family of Latin squares from which the one actually used is 
chosen at random. 

Now we examine the expected value of treatment totals, of the error 
of treatment totals, of the treatment sum of po and so on. By 
definition p;, Yj, and r have zero means. 

A treatment total T, is equal to 


tu + tet Oden (4) 
uU 


Now if we choose a particular ¢ X t Latin square and randomize rows, 
columns, and treatments, ô% is equal to unity with probability 1/¢ and 


equal to zero with probability (=> So the expected value of T'ẹ is 
1 
E(Ty) = lu + tre + : Deu 
ij 
= tu + r4) (5) 
The variance of a treatment total is equal to ; 


E(T, — E(T)P = ( seu) 


-E| E airy E Yes 


tei j 
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From the structure of Latin squares, we have: 


If 
a= 1 then 3,20 and 35 =0 
and if é 


1 
5% = 1 then 3X = 1 with probability "EM 


The variance of a treatment total is then 


Leu eur pd X Dewey Ees 


t ij 1 578 

l «)- De €ij — 2 pa eiei'j -5 2 «e| 
5 ur — 1) TERE AIT $ jud 

ut 
x iles E do ed (= ) 
iud j 1 1 7 
= - Les ' 

and 4 

22. x. Ct mE Mes 

i j=j 


since 
Des = Leys = 0 
i j 
The variance is ag 


(Se u(t — cree] - (2) 3] 


= — Len 7 
RIEN x i (7) 
The covariance of any 2 treatment totals 
E 
is found to be x 1 
= ui 2 Pij (8) 


The variance of any linear contrast of the treatment totals 
DAT; with Dr; = 0 
is then 


Deg- e D plow) 25. 


(20%) 5 
— 1 ij 


"D gy (9) 


ND 
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Infinite model theory leads us to the partitioning for the analysis of 
variance given in Table 10.3, and we proceed to obtain the expectations 


Taste 10.3 » 
df 
Rows t—1 
Columns t-1 
Treatments 11 
Error (t — 100 — 2) 
Total 1 — 1 \ 


of the mean square under the model we are using. It is found that 


t 
E (row mean square) = IS L pi 


t 
E (column mean square) = ae E y 
; (10) 
t 
Sen 


1 
(t — 1? 7 t-1% 


E (treatment mean square) = 


1 
E (error mean square) — u-i — ei 
19 


The Latin square is, therefore, unbiased in the sense of the expectation 
of the mean square for treatments equaling the expectation of the mean 
square for error under the null hypothesis that the treatments have 
identical effects on every plot or experimental unit. 

It may be further noted that, if the expectation of the mean square 
for error.is denoted by c?, the variance of any contrast of treatment 
means 


EXT; with Da; =0 


is (Net, and that the covariance of two contrasts given by ^; and 
X; is (ZA j)o?/1. 

We are now in a position to understand the rule stated by Fisher * 
that the random Latin square should be chosen out of a number of 
Latin squares, in which every pair of plots that do not occur in the 
same row or column belongs to the same treatment with equal frequency. 
In our derivation of the analysis of the Latin square, we used the result 
that, if ô equals unity, then db, with i i' and i, equals unity 
with probability 1/ % — 1). The probability of plots (ij) and (%) be- 


" 
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ing occupied by the same treatment is therefore 1/1 — 1), the same 
for all treatments. It may be noted in the derivation that we obtained 
the results using only the properties of any individual Latin square, 
such as that the probability that 35 equals unity is 1/4, together with 
the statement that the probability that tot; equals unity is equal to 
1/t(t — 1). If we had not chosen these rules, the expression in equa- 
tion 6 would not be the same for all treatments. Furthermore there 
would be no possibility of estimating the variances and covariances such 
as E(T, E(T F or E((T« — E(T9] - (Tx — E(Ty:)]}. 

The testing of the hypothesis that there are no treatment effects is 
made by the randomization test. In view of the expectations given 
above, a criterion which is intuitively reasonable is that of (treatment 
mean square/error mean square). This will be evaluated for the square 
actually used and for all other squares that we could have obtained by 
the randomization procedure. If the value for the square actually used 
is equaled or exceeded by that of 5 percent or less of the possible ar- 
rangements, we shall say that we have significance at the 5 percent 
level, The evaluation of the significance level in a particular experi- 
ment would be a very laborious task, and we rely on the fact that the 
distribution’ of the criterion will be closely approximated by the F dis- 
tribution with (£— 1) and (t — 1)(t — 2) degrees of freedom. This 
distribution would hold exactly if the error terms in the model were 
normally and independently distributed with mean zero and variance 
c?. The extent to which the distribution of the criterion over the pos- 
sible randomizations may be'represented by the F distribution has been 
examined by Welch. We have seen above that the quantity (treat- 
ment sum of squares/treatment plus error sum of squares), U, say, has 
a mean value of 1/(£ — 1), and this is the mean value of the beta dis- 
tribution which is the transform of the F distribution. This was ob- 
tained, moreover, with only the specification that the probability that 
565 7 equals unity is 1/t(t — 1) and therefore holds for any transforma- 


tion set. 
Welch ? found that the variance of U depended on the transformation 


set, and also on the quantities: da^ 
D= x 5 n F= x e) 
2 2 2 
Y Tei) (Cen). H = (Eeen) 
1 j j 5 1 im 7 


Welch examined the variance of U for some constructed data and for 
some sets of uniformity data and found that the proportion of times 
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the 5 percent value of U from the beta distribution was exceeded ranged 
from 2.7 to 6.2 percent. The approximation by the F distribution is 
therefore not entirely satisfactory, but the evidence is not conclusive, 
in that the approximation depends on the quantities D, F, G, H above, 
and, in a particular case, we do not know these values, nor do we know 
the values we shall meet in practice. The rules given above for the 
choice of a random Latin squaré are designed to give equal probability 
to all possible Latin squares of size less than 7 X 7, and in the present 
state of knowledge this appears to be a desirable procedure. To con- 
clude this aspect of the Latin square, we shall assume that normal 
theory gives satisfactory approximations to corresponding randomiza- 
tion tests. 

Finally we should note some properties of the smaller Latin squares 
and the impact of these properties on randomization tests. We con- 
sider first the 2 X 2 Latin square, for which there are only 2 different 
ones: namely, 

A B B A 


and 
B A A B 


"This square has no degrees of freedom for error, as is obvious from the 
fact that, if we use one square and obtain the treatment difference, then 
the treatment difference given by the other square is the negative of 
the difference with the former square. If then we wish to compare 2 
treatments with 2 X 2 Latin squares, we must use many squares, and 
to make any test we must assume that the difference is constant from 
Square to square. The randomization test is so simply performed in 
this case, that with a small number of squares, say, 6 or less, it would 
probably be advisable to rely on the randomization test procedures 
rather than the usual F distribution approximation (unless, of course, 
one can assume the infinite model). 

In the case of the 3 X 3 Latin square, it is important to note that 
there are, in fact, only 2 different partitions of the 9 cells into 3 sets of 
3, in such a way that each set is represented in each row and in each 
column. There are 12 different 3 X 3 Latin squares, but these give 
the same partitioning in sets of 3. If we wish to test the null hypothe- 
sis that there are no differences among the 3 treatments, we shall use 
the ratio of treatment mean square to error mean square as the test 
criterion’ If this takes the value R with the randomization we in fact 
used, it will take the same value for 5 of the other 11 randomizations, 
and the value 1/R for the remaining 6. This happens because the sum 
of the treatment sum of squares with 2 degrees of freedom and the error 
sum of squares with 2 degrees of freedom is constant for all randomiza- 
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tions, and a randomization that gives a partitioning different from the 
one actually used will have the treatment and error sum of squares in- 
terchanged. We are, therefore, in the position of not being able to 
make a significance test, for which the chance of rejecting the hypothe- 
sis when true is less than 50 percent (or, in other words, of size less than 
0.50). This fact is important because, if we use the infinite model in 
which the errors in the model are assumed to be normally and inde- 
pendently distributed with mean zero and constant variance c^, we 
shall use the F test with 2 and 2 degrees of freedom and can make a test 
at any significance level we please. The distinction we make through- 
out this book between the finite and infinite model is therefore extremely 
relevant. If we consider a particular treatment contrast, and evaluate 
it for the 12 possible 3 X 3 Latin squares, we shall find that there are 
6 possible values which the criterion (mean square due to treatment 
comparison/error mean square) can take. We therefore only make a 
test of significance with level 1-in-6, of the hypothesis that the true 
comparison is zero, if we use a 2-tailed test. For these reasons, a single 
3 X 3 Latin square experiment is virtually valueless, and, if we use a 
small number of repetitions, we should, as with the 2 X 2 square, prob- 
ably use the randomization test procedures, although it is often found 
that the usual F test gives a reniarkably similar answer. 

There are in all 4(413!) or 576 different 4 X 4 Latin squares, but these 
lead to only 24 different partitions of the 16 cells into 4 sets of 4, in 
such a way that each cell is represented in each row and in each column. 
It is therefore desirable to make the test strictly according to the ran- 
domization test procedure. 

Squares of side 5 and 6 were examined by Welch in the afore-men- 
tioned work. For squares of side 7 or more it seems reasonable to as- 
sume that the F distribution is satisfactory. 

We shall not give a lengthy discussion of the analysis of variance 
when the additive model does not hold. It is clear that, if there are 
row-treatment or column-treatment interactions, these will enter into 
the error mean square but not into the treatment mean. square. The 
situation is entirely analogous to that of randomized blocks-in that 
block-treatment interactions enter the error mean square but hot the 
treatment mean square. Using a scale of measurement on which ef- 
fects are additive is, therefore, very important. For tests-of hypothesis 
we rely on the validity of F tests and ! tests in finite populations. 

We may, therefore, use the model b 


— 


io 


ye = n bibit mee = 


> 


the quantities u, pi, Yi and rz, being fixed unknown constants and the 4 
. ^Oovi 


—7 12 
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eijk 8 being normally and independently distributed around zero with 
constant variance as an easy substitute for the laborious restricted sam- 
pling approach. Alternatively one may prefer to use the infinite model 
from the start. There is only one difference, other than those we have 
already mentioned in connection with tests of hypotheses, between the 
two approaches: namely, that the variance of a treatment mean for 
comparison with results of other experiments is / with the infinite 
model but c?/(t — 1) with the finite model. When we make a state- 
ment about the variance of a treatment mean, we shall mean the vari- 
ance appropriate for comparisons within the experiment, which is, in 
this ease, o”/t. In this way we may ignore algebraically the correla- 
tion of treatment means. 


10.6 ANALYSIS.OF THE LATIN SQUARE WITH THE 
INFINITE MODEL 


The basis of the usual analysis of the Latin square is the assumption 
of a model 


Vix = M + pi + Yj + Tk eie i=l t 

where j21, t 
m = the contribution common to all plots 

p; = the contribution common to all plots of the ith row 


yj = the contribution common to all plots of the jth column 
Te = the contribution common to all plots of the kth treatment 


and the er's are random errors, normally distributed about a mean of 
zero with constant variance cs. 

This model leads to the analysis of variance (Table 10.4), where Rj, 
Cj, Tr, and G are row, column, treatment, and grand totals, respectively. 


TABLE 10.4 ANALYSIS OF VARIANCE FOR A (X t LATIN SQUARE EXPERIMENT 


* Mean 
Due to df Sum of Squares Square 
2 
Rows t-1 2 E: E e R 
t e 
Columns t-1 — — a [^ 
t " 
Treatments t-1 z T^ oe 
t 6 
Error (t — 1t = 2) By subtraction E 


Total e-1 Ipa- 7 


MISSING DATA 197 


The mean square E is an estimate of a°, and, if there are no differential 
treatment effects, i.e., the 7;'s are equal, the mean square T is an esti- 
mate of 02, both sums of squares being distributed independently ac- 
cording to x?c?, with the appropriate number of degrees of freedom for 
x2, by virtue of Cochran’s theorem (ef. Chapter 5). 

The estimated standard error of each treatment mean will be V E/r, 
which is appropriate for any treatment comparison. The results may 
be presented simply as in the case of randomized blocks: namely, à 
statement of treatment means with this standard error. Errors of par- 
ticular comparisons, confidence limits, and so on are obtained as in 
that case, and the treatment sum of squares may be partitioned simi- 
larly. 


10.7 MISSING DATA 


The solution for 1 missing plot is fairly easily obtained and will be 
given. Suppose the yield on the plot in row 1, column 1, is missing 
and that this plot received treatment 15 

Let R; (i = 2, . . t) be the total for the ith row, C; (j = 2, +, t) be 
the total for the jth column, and T, (k = 2, «++, t) be the total for treat- 
ment k. Let R', be the total of the known yields in row 1, and define 
C', and 7 in the same manner. G' is the total of all known yields. 

The procedure, as in the case of randomized blocks, will be to mini- 
mize the error variance with respect to the missing plot. In the anal- 
ysis of variance given above we have the modification shown in Table 


10.5. \ 


Taste 10.5 
Due to Sum of Squares 
1 Ké G +2)? 
Rows imt 2! t1 2 R’: = CIT ) 
1 12 G' ＋ zy 
Columns 1s % iy 0s - S3 
t t n t 
1 15 @ +2) 
Treatments <(T +) +7 YT — 3 
t 1 t 
Error Difference 
(G' +2)? 
Total 12 5 yu — z 
^ wk t 


We differentiate the error sum of squares with respect to 7 and, set- 
ting the derivative equal to zero solve for . We need consider only 


those terms involving 7, say, Q, where 
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Gp GEO QUE 
EL w 
P t t t 
@+x? 1% 2 (G +2)? 
EST euim RS EO 9 
2060 u 1 
. = Bi Ho? + (Ca +a)? + (T 2] 


4(G'--r) 2 
Mea e D Pup, ai) eCity tito 

Ox t t 

lt can be easily verified that setting this equal to zero and solving for 
x yields 

tR’; + (05 + LT, — 26" 

t = ee — 

(t— 1)(t —2) 


In general, if the yield corresponding to the uth row, vth column, wth 
treatment is missing, then the estimate of that yield is 


UC, + tC’, + tT’, — 2G" 
r= 
(t— I(t 2) 


where the quantities R', C’,, T, and G’ are defined as above. As 
before, we may replace the missing yield with this quantity and per- 
form the analysis of variance exactly as above with this modification: 
The degrees of freedom for error will be (t — 1)(t — 2—-120— 
3t + 1, and for the total we will have 42 — 2 degrees of freedom. The 
usual tests of significance may be performed, but the F will have an 
upward bias. Thus, if non-significance is found, we can stop. If F is 
significant, however, we cannot be sure that it is due to treatments and 
not to this bias. 

Exaet tests of significance in terms of infinite model theory, although 
easy to describe in- terms of general theory, are somewhat difficult to 
obtain. It is necessary to evaluate the sum of squares attributable to 
rows and columns ignoring treatments, and to rows, columns, and treat- 
ments. The difference of these 2 sums of squares may then be tested 
against the error with the reduced sum of squares. To compute the 
necessary quantities, the experiment is first regarded as an experiment 
in rows and columns with one observation missing and the minimum 
sum of squares for error obtained. This sum of squares, W, say, will 
have (i? — 20) degrees of freedom. The minimum sum of squares for 
error, when treatments are taken into account, is obtained by analyzing 
the augmented table, E, say, with ( — 3t + 1) degrees of freedom. 


(11) 


å — A 
ccc r e a£ 


THE CASE OF A MISSING ROW, COLUMN, OR TREATMENT 199 


The quantity (W — E)/(t — 1) is the mean square for treatments, 
which is tested against E/ (f - 3t + 1) by the F test with (¢ — 1) and 
(2 — 3t + 1) degrees of freedom. 

If more than 1 plot, say, n, are missing, we can denote them by 2, 
rz, +++, n and proceed exactly as above. Partial derivatives with re- 
spect to the z;'s set equal to zero will give n equations in the n varia- 
bles, which can be solved for exact solutions. However, if n is greater 
than 2 or 3, the algebra becomes very involved and tedious. Yates * 
has given an iterative method for solving for these unknown yields. 
For the plots zo, za, +++, Tn we substitute the general mean of all known 
yields, G'/(2 — n) and solve for zı as above in the case of 1 missing 
plot... Using this value for z, we can solve for xa, ete. For the first 
approximation the quantity G' can be left equal to 


dem 
(n 


until all n 17's are calculated. These values, say, z^; are then put into 
the place of the missing plots, the new marginal and treatment totals 
are caleulated, and a second approximation is caleulated in the same 
manner. Yates? states that two approximations usually give suffi- 
ciently accurate values. More approximations are necessary if greater 
accuracy is desired. 

The analysis of variance is then performed as with 1 missing plot, 
with the same restrictions. The degree of freedom for "error" and 
“total” are reduced by n from what they would be with no missing 
plots. The method for accurate F tests is unchanged. 


10.7.1 The Case of a Missing Row, Column, or Treatment 
The analysis of a Latin square experiment with a missing row (say, 
row 1) may be made in terms of the model 


vl = nc eic vi T ĉijk 


where 
i= 2, 3, „„ 
gj 1, 2, 3, „ f 
N 


Least squares leads to simple equations for estimating the constants. 
A similar setup is used for the case of a missing treatment. Suppose 
the rows and columns are named so that the missing treatment, say, 


K: 
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treatment 1, lies along the leading diagonal. Then the normal equa- 
tions are, utilizing the conditions, 20; = 24; = If = 0: 


t(t — 1)à $G 
(t — a ＋ (t- 1) 51 — fi = Rı 
(t — 1)à + (t — 1)f2 — Fe = Ra 


(t— D& hi T (t—0$5-76i (12) 
(t — 1)& — f» + (L— 1) = C2 


DEL TED OREL CU T O 


ia + 05 = T, 
ta + f = T3 


where G, Ri, Re, +++, Ci, Co, +++, To, Ta, +++, are, respectively, the 
grand total, row totals, column totals, and treatment totals. The es- 
timates of treatment differences are given by differences of the observed 
treatment means. The only further question is the analysis of variance. 
The estimates of the row and column parameters are given by the 
equations, 

(t — 1p + Ut — 2)5; = (t — DR; + Ci 


Ut — VR + tt — 2)$; = (t = 1)C; + Ri 


The sum of squares due to fitting the p's and y’s may be split ihto two 
portions: 


(13) 


1. Sum of Squares for Columns Ignoring Rows: 


1 G? 
— EC - ——_ 14 
5 sd 
2. Sum of Squares for Rows Eliminating Columns: 
G? 4 
— p —— 15 
t(t — 1)(t 2) ibe wong 9 
The error sum of squares is obtained by subtraction. The variance of 
treatment means for comparison of means is, of course, %.. 


EFFICIENCY OF LATIN SQUARES 201 


The reader may refer to Vates“ for a discussion of the above and of 
the case when both one row and column are missing and to Yates and 
Hale ? when 2 or more rows, columns, or treatments are missing. 

An important fact about the Latin square with 1 row, column, or 
treatment missing is that the design is unbiased in the sense that the 
expectation over possible randomizations of the error mean square is 
equal to the expectation of the treatment mean square. The same holds 
for the case of 1 row and 1 column, 1 row and 1 treatment, or 1 column 
and 1 treatment. The reader is referred to Yates * for proofs. By vir- 
tue of these facts, such patterns give valid experimental designs and can 
be used directly when the occasion arises. No examination of these 
patterns from the point of view of randomization tests except in re- 
gard to the mean value of the test criterion appears to have been made. 


10.8 EFFICIENCY OF LATIN SQUARES 


It may be desirable to test whether the row classification or the col- 
umn classification or both have led to increased precision in the experi- 
ment. To obtain relative efficiencies suppose the mean squares in the 
analysis of variance of the Latin square are labeled as in Table 10.6. 


Taste 10.6 

Mean 

Due to df Square 
Rows r-1 R 
Columns r-i C 
Treatments r-1 T 
Errors (r — Ir — 2) E 

Total 12 — 1 


With rows as blocks, and no treatment effects so that T will on the 
average equal E, the analysis of variance would be as shown in Table 
10.7. 


Taste 10.7 
Due to af, Sum of Squares 
Blocks (rows) r-1 R 
Error r(r — 1) (r — DC + (r = Y'E 


If then the column classification had not been made, the error mean 
square would have been 9 
= Der- DE Ctr- DE 
r(r — 1) ^ r 
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and the efficiency of the Latin square relative to randomized blocks 
made up by rows is estimated by 


(r— DCt(r-1yE Cr(r- 17 
r(r — 1) E A rE ! 


Similarly, the relative efficiency of the Latin square to randomized 
blocks made up of columns is estimated by 


CDR TCE R+(r-1)E 
r(r ＋ DE y. rE 


(16) 


(17) 


The efficiency of the Latin square relative to complete or unrestricted 
randomization is estimated by 


(r-D)Rct(r-DC-c(r-1'E R-C-(r-DE 
(? — DE 8 (r+ DE 


In the above we have assumed that exactly the same plots would 
have been used in either of the other designs considered. The argu- 
ment given is an intuitive one. It may be verified by the reader that 
an approach by the finite model gives the same result. 

It may be noted that it is possible to estimate the efficiency of a par- 
ticular design, relative to other desigus obtained by dropping any of 
the restrictions in the particular design, from the results of actual ex- 
periments. This procedure is entirely valid, but it must be remem- 
bered that, if, to take an example, randomized blocks of size r were to 
be used instead of a Latin square, the best shape of block from the 
point of view of experimental procedure might have been of shape other 
than that given by rows or columns. This tends to vitiate many com- 
parisons that are made in this way. The argument here is entirely 
one from the point of view of estimation. 


(18) 


10.8.1 Some Results on Efficiencies 


Yates in his paper, Complex Experiments," 1° gives some results on 
the efficiencies of complete randomization relative to randomized blocks 
and Latin squares for the case of field experiments: 


1932 1933 
Randomized blocks 72% (22) 75% (22) 
Latin square 54% (38) 57% (87) 


The figures in brackets denote the number of experiments on which the 
means efficiencies are based. j 
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It may be deduced that with this type of experiment and experi- 
mental unit randomized blocks necessitate about 44 (72-75%) the num- 
ber of plots that the completely randomized experiment requires to 
achieve a particular accuracy. A Latin square requires about 14 the 
number of plots. 

On another set of experiments he found that the efficiency of ran- 
domized blocks relative to Latin squares was about 60 percent. In a 
comparison of 5 X 5 Latin squares and randomized blocks of 5 plots, 
he found that about 214 times as many plots were necessary with the 
randomized blocks as with the Latin squares to achieve a particular ac- 
curacy. These results should be regarded only as an indication of the 
sort of results that may be obtained with different experimental material. 


10.9 DESIGNS BASED ON GRAECO-LATIN SQUARES 


A Graeco-Latin square pattern may be utilized to compare ¢ (not 
equal to 6 or 10) treatments if the experimental units can be classified 
in 3 mutually orthogonal ways, corresponding, say, to rows, columns, 
and Latin lettets. The treatments will be assigned to the Greek let- 
ters. These designs may, however, be unsatisfactory from the point of 
view of randomization tests. To take the case of ¢ equal to 7, the treat- 
ment sum of squares is a random 1% of the treatment plus error sum of 
squares (see Chapter 17). A test of significance can, therefore, work 
only at the level of rejecting the hypothesis that there are no treatment 
effects in Ig of cases when it is true. For this reason, these designs are 
not to be recommended for any purposes other than exploratory. Their 
range of utility is restricted very much also by the necessity of having 
an orthogonal 3-way classification of the experimental units. 


10.10 THE USE OF SYSTEMATIC LATIN SQUARES 


In accordance with the basis of inference on which we rely through- 
out, we shall not consider the use of systematic Latin squares such as 
the Knut Vik square. The reader should refer to Fisher " for a discus- 
sion of this matter. The conclusion reached was that systematic 
squares prevented an estimation of the error of each treatment compari- 
son and should not, therefore, be used. We shall examine the Knut 
Vik square in Chapter 18 when we have developed a notation that is 
particularly convenient for the purpose. Any of the designs that we 
consider apart from those using complete randomization are in à sense 
systematic, but we attempt to ensure that we always have a reasonable 
randomization test. Without such a test, we are completely at the 
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mercy of whatever pattern of heterogeneity Nature chooses to impose 
on the experiment. 


10.11 FURTHER REMARKS ON LATIN SQUARES 
The following remarks may be made about. Latin squares: 


1. The need for transformations may arise as with randomized blocks. 

2. A disadvantage of Latin squares is that the analysis becomes 
rather arduous if whole rows, columns, or treatments are missing. 

3. It is not possible to partition the error sum of squares into compo- 
nents for particular treatment comparisons. If then the yields unde: 
` 1 treatment are subject to a variance different from that with other 
treatments, the analysis becomes difficult if not impossible: This does 
not, fortunately, happen very often, and, if the experimenter has any 
inkling that such a possibility may occur, which cannot be corrected 
by a transformation, he should avoid Latin squares. z 

4. In general, the Latin square will be more efficient than the ran- 
domized block experiment, if only because a second classification added 
to a block classification ean never lower the true efficiency. 

5. The number of replicates must equal the number of treatments, 
and for this reason Latin squares are not popular with 8 or more treat- 
ments. 

6. Squares of size 4 X 4 or less are unsatisfactory from the point of 
view of randomization tests and should be repeated; the same holds 
with the infinite model because of the low number of degrees of free- 
dom for error. 

7. The large Latin squares suffer from another defect that column 
effects, for example, could vary considerably over the experiment, and 
also row and column interaction with treatments become more likely. 


t 
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CHAPTER 11 


Plot Technique 


11.4 INTRODUCTION 


Under this general heading will be considered matters relating to the 
choice of experimental unit for various types of experiments. "There 
are very few general considerations, but a large body of information has 
been accumulated over the past twenty or so years on field plot tech- 
nique, that is, technique for field experiments. Most of the difficulties 
are illustrated by this case, which will be described, and the reader 
should have no difficulty in translating notions like size and shape of 

plot and block into the language of another subject-matter field. The 
uses of sampling in experimentation will also be discussed. 


11.2 FIELD EXPERIMENTS 
The following matters are of importance: 


1. Size and shape of plot. 
2. Size and shape of block. 


The considerations that influence the choice on these matters are of 
two types: statistical and other. Under statistical considerations we 
include topies such as the effect of size and shape of plot on error vari- 
ance and accuracy of estimation. The non-statistical considerations in- 
clude such matters as the feasibility of particular sizes and shapes of 
plot from the point of view of experimentation, 


j 


11.2.1 Size and Shape of Plots 


The most extensive investigation on size and shape of plot and size 
of block is that of Fairfield Smith.! By harvesting a crop in very small 
units, he found that the variance per unit area for plots of area z units 
was given approximately by 

p.491 
V: = P (1) 
206 


SIZE AND SHAPE OF PLOTS 207 


where b is a characteristic of the soil, and a measure of the correlation 
among contiguous units. For example, if b — 1, V, = Vi/z, and the 
units making up the plot of z units are not correlated at all. If, on the 
other hand, the æ units are perfectly correlated, b = 0 and V; = Vi, so 
that there is no gain due to the use of the larger size of plot. In general, 
b will be between zero and unity, so that the larger plots give more in- 
formation with the same number of plots. This is to be expected in 
that a larger experimental area is being used. This formula can be in- 
terpreted in the other direction: Suppose we are to use a fixed area, so 
that we have the choice of r plots of size x units, 2r plots of size 2/2 
units, 3r plots of size 2/3 units, etc., for each treatment. The vari- 
ances of treatment means will then be as shown in Table 11.1. 


Taste 11.1 


Variance of 
Size of No. of Treatment Means 
Unit Replicates per Unit Area 


Vz 

T p — 
$ r 

z Vz/2 
2 * 2r 
z Yars 
3 il 3r 
zx Vink 
k E kr 


Using the above empiricial relationship the variance of treatment 
means per unit area with kr replicates is 
1 Yi Vi 1 


EP 7b kao) 
(2 


and this decreases as k increases since b must be between zero and unity. 

This argument would lead us then to the use of as small a plot as 
possible (as large k as possible), and this is what is generally done. 
There is, however, a definite lower limit in a partieular experimental 
situation on the size of plot. First, regardless of size of plot a certain 
amount on the border of the plot has to be rejected because there may 
be some carryover of treatment effects from plots to neighboring plots. 


(2) 
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Second, it is necessary to use certain agricultural equipment for the cul- 
tivation and other agricultural operations on each plot; the gain from 
small plots may be more than offset by the increased cost of these ex- 
perimental details with the small plots. Third, the argument assumes 
that the amount of work involved in the experiment is proportional to 
the area, whereas it is more reasonable to assume that the total eost is 
a function of the area and the number of plots. 

As the size of plot decreases, the proportion of the experimental area 
that has to be devoted to guard rows or areas becomes very large, and 
this, together with the cost of agricultural operations, tends to produce 
a medium-sized plot. For example, with experiments on agronomic 
treatments on potatoes, a row crop, or small grains a plot of }goth to 
Moth of an acre has been found to be more or less optimum. ‘The exact 
details of this problem are a topie for the subject-matter field under 
consideration and will not be diseussed here. An easily examined in- 
stance of difficulties arising from border effects occurs in tree ex- 
periments, say, on apple trees. If the experimental unit is 1 tree and 
it is necessary to have each experimental unit guarded from each other 
by 1 tree, the experimental setup will be of the type shown in Figure 9, 
€ denoting an experimental tree and g a guard tree. 


FiavRE 9. 


With this arrangement somewhat less than one half of the trees in an 
experiment will be non-experimental. It is easily verified that, as the 
size of experimental unit increases, the proportion of non-experimental 
trees decreases. 

In agricultural erops and particularly tree crops the question of size 
of plot must be considered in relation to the amount of competition and 
the effect of treatments on adjacent plots that may be expected. In 
some instances one might expect the effect of competition will be to 
lower treatment differences for a tree experiment. In some cases tak- 
ing account of the difficulty of using guard trees, plots of individual 
trees may be recommended. It is, of course, necessary to consider the 
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actual treatments being investigated, and no general rules can be stated. 
A design that was found to be very successful recently in the determi- 
nation of a small effect on corn utilized plots of a single kernel of corn. 
With this size of plot the amount of replication possible was, by ordi- 
nary standards, tremendous. 

Fairfield Smith found little effect of shape in the sets of uniformity 
data he examined, but this is somewhat contrary to our general expec- 
tation. If there are no fertility trends in the experimental area, we 
would expect long narrow plots to be more efficient, as the correlation 
between small areas within the plot will be less than in a square plot of 
the same area, if it is assumed, as appears reasonable, that the correla- 
tion between two points is a function of their distance apart. If, how- 
ever, the experimenter uses long narrow plots which run perpendicular 
to the direction of fertility changes, he may expect to obtain lower ac- 
curacy than with square plots and a fortiori with the same-shaped plots 
running parallel to the direction of fertility changes. In the absence of 
any knowledge of fertility trends, it is probably better to use square 
plots, though again experimental details, such as ease of cultivation, 
sowing, and harvesting, may lead the experimenter to rectangular plots 
with one dimension different from the other. There is, of course, no 
necessity of insisting on rectangular plots except for reasons of con- 
venience. Sometimes in experiments on terraced land it may be neces- 
sary to use plots that are not rectangular. 

An original type of experimental unit was de- 
vised at the Connecticut Agricultural Experi- 
mental Station for the testing of fungicides on 
plants. The difficulty arose that the plants have 
to be watered every day. The experimental area 
was a continuous row of plants somewhat in the 
form of an equiangular spiral (Figure 10). 

The water was brought to the plants by means Fioure 10. 
of an underground pipe to the center of the 
spiral, a vertical pipe, and a horizontally swinging arm, at the end of 
which was a rubber hose. It was then a simple matter to turn on the 
water, walk around the spiral, and water the continuous row. The 
experimental unit was, in this case, a particular length of row. This 
example is mentioned to indicate that there is scope for ingenuity in 
the choice of a suitable experimental unit. 

If Latin squares are to be used, the more nearly square the plot is, 
the more efficient the Latin square may be expected to be, from general 
considerations. For example, with 9 treatments on corn, a9 X 9 Latin 
square with 2 by 10 hill plots will be of dimensions 18 by 90 hills (dis- 
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regarding borders). Such a design has considerable defects. It may 
not bé easy to find a reasonably homogeneous area of these dimen- 
sions, and also column effects at one end of the experiment may be 
very different from column effects at the other end. Such an effect 
would increase both treatment and error mean squares. It would not 
introduce any bias in the estimation of average effects but would render 
an analysis very difficult and would result in lower efficiency. 


11.2.2 Size and Shape of Blocks 


The size of block in an ordinary randomized block experiment is de- 
termined by the number of treatments, the size and shape of plots, and 
the way they are aggregated into blocks. In general the division of the 
experimental material into blocks is made in such a way that plots 
within blocks are as homogeneous as possible. Blocks should remove 
as much of trends in the material as possible; for example, if there is a 
fertility trend from north to south on the experimental land, the blocks 
should lie in that same direction relative to each other. Each plot 
should be as representative as possible of conditions in the block so 
that one reaches an arrangement like that shown in Figure 11. 


Plots 


Fertility trend 


Ficure 11. 


In the absence of any knowledge of trends in the experimental ma- 
terial with regard to the characteristic observed, it is better to use plots that 
are more nearly square and to make the blocks as compact as possible. 

Fairfield Smith! deduced the following relationship for the variance 
per unit area between plots of size z units in blocks of m plots, 


m(1 — m^") 
N 1 


(V35 cJ 


(Vz) a (3) 
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where (V), is the variance in an infinite field, and hence he obtained 
the relative efficiency of blocks of m plots relative to blocks of n plots 
to be the same, regardless of size of plot and equal to 


(V). _ n(m - D( — 75 
(Fin, mn - 1)(1 — m^) 
The value of this formula is limited, because the value of b is erratic 
over different areas, and one cannot predict the value that one will 


meet. Fairfield Smith found it to lie generally between 0.2 and 0.7. 
The results in Table 11.2 are calculated from the above formula. 


(4) 


Tasie 11.2 Erricrency or Brocks or z Prors 


T 5 10 20 40 


b = 0.2 1.50 1.30 1.13 1 
b=0.7 1.12 1.06 1.03 1 


In general, it is best to make the blocks as small as possible, and this 
is the reason for the use of incomplete block designs to be diseussed in 
later chapters. These are designs for comparing a number £ of treat- 
ments in blocks of less than ¢ plots. In some cases the gain in informa- 
tion from using the smaller blocks will be small, but generally it will be 
considerable, as evidenced by the fact that most trials involving a large 
number of varieties are arranged in some incomplete block arrange- 
ments. 


11.3 ANIMAL EXPERIMENTS 


In this group we include experiments on cows, for example, and ex- 
periments whose purpose is to perform a biological assay, for example, ` 
with ratsor mice. "Very little is known, but some pointers and warnings 
of pitfalls may be given. 

We remember that the experimental unit is defined as the unit for 
which a treatment is chosen at random. For example, with a hog- 
feeding experiment it may be convenient to apply the treatment to 
groups of, say, 6 hogs, the hogs having a common feeding arrangement. 
It would be a mistake to regard the individual hog as the experimental 
unit, because there will be competition between animals within a lot. 
In field experiments the purpose of guard rows is to prevent, plots from 
being influenced by the treatments on neighboring plots and to some 
extent to prevent competition between plots: How important the com- 
petition effect will be depends on many factors: the duration of the ex- 
periment, the extent to which the animals in a lot are of the same size 
and vigor, and so on. If the experiment is of long duration, there are 
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large treatment effects, and the animals were initially of different vigors, 
the treatments may enhance these differences and result in their be- 
coming larger. Under most circumstances the variance within lots may 
have little meaning, and it is extremely risky, for example, to draw in- 
ferences for one size of lot from what was observed with another size of 
lot by the use of components of variance. 3 

To give another example of the difficulties that may arise in animal 
experiments, consider a grazing experiment, where it is necessary to 
graze experimental areas with animals, say, cows or sheep. Such a 
problem arises often on its own, and very frequently in rotation experi- 
ments, when one or more crops of the rotation are to be grazed. If a 
very small plot is used, it is not possible to graze with more than one 
animal, and animals do not like being segregated to this extent. The 
animal will spend most of its time walking around the boundary of the 
plot looking for a way of escape, and the whole purpose of the experi- 
ment will be vitiated. If a large plot is used, this problem is avoided, 
but very low statistical efficiency results. For sheep it has been found 
that plots of Yo of an acre are reasonably satisfactory, though rather 
on the small side, but for large animals such as cows the best size of 
plot appears to be between 1 and 5 acres. Another point is that, with 
very few animals, the yield of a plot, say, by live weight increases, is 
subject to considerable errors of measurement. 
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We have seen that the optimum size of experimental unit is governed 
by many considerations. Frequently it is not possible or not desirable 
to measure the characteristic, say, yield, on the whole of each experi- 
mental unit, or it may be desirable to estimate some characteristics on 
the whole of the unit and other characteristics on a random sample only 
of the unit. To examine these questions, it is necessary to choose a 
sampling unit and, this having been done, to obtain data that can give 
the necessary information. 

Suppose then that we have an experiment in r randomized blocks of 
t plots and that the characteristic has been observed on a random sample 
of s sampling units from each plot. The observations may be denoted 
by vn where i denotes the block (i = 1, 2, . .., r), j the treatment 
(j = 1, 2, , 0, and k the sampling unit (k = 1, 2, ***, 8), and we 
assume the following model: 


yis = M + ri + lj + eij + nije 
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where 


m = the general mean 

r; = the replicate effect 

1j — the treatment effect, 

eij = the experimental error of plot (ij) 


and 
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"jk = the sampling error of the kth observation on the (j) th plot 


The expectation of n will be zero, and we suppose that the expecta- 
tion of ei is zero. We suppose for the present purpose that the nij’ s 
are normally and independently distributed with the same variance o, 
and the eis normally and independently distributed with variance 92, 
The vis will, of course, be independent of the e;j's if the sampling is 


random. 


This model leads to the analysis of variance on a sample basis given 


in Table 11.3, where 


Due to df 
Replicates r=1 
Treatments t-1 
Replicates by 

treatments * 90 1) 


Samples within 


plots ri(s — 1) 


Total ris — 1 


TABLE 11.3 
Mean 
Sum of Squares Square 
3 Lr. 0 
te 7 
2 L 0 T 


i ark = Dd vii 


Expectation of Mean Square 


os toot i L105 


a, + 80% 
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The test of significance for treatment effects is, of course, the F test of 
T/E with (t — 1) and (r — 1)(t — 1) degrees of freedom. 
The components of variance o°, and o°, may be estimated by 


62. 8 
N 
8 


(5) 


#, = 


The estimated variance of treatment comparisons on a per sample basis 
will be proportional to E/rs. 
We may estimate the variance of treatment comparisons with, say, 
r’ replicates and s samples per plot to be proportional to 
F 


r ET à r's 
E 871 1 
res: 2 8 3 (6) 
eS Ny ig 


Note that, when r’ = r, s' = s, this equals E/rs as before. The rela- 
tive information with varying values of r’ and s’ may then be estimated, 
that for 7' replicates and &. samples per plot, relative to the use of r 
replicates and s samples per plot, being 

: r's'E 

r[s'E + (s — ) 
With infinite sampling of each plot (s’ = æ), the efficiency becomes 
rE 
E — S) ‘ 

and this is the maximum that can be achieved. This will often be un- 


economical, and it is necessary to consider the costs of the various oper- 
ations. 


A simple cost structure is to let 


(7) 


(8) 


C = cost per plot excluding harvesting 

C, = cost per sample of harvesting 
With r replicates and s samples per plot the cost of the experiment per 
treatment is rC + rC, 


The information on each treatment mean, assuming the variance com- 
ponents to be known, is 
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PASISME Y 
02, + 802, 


We shall wish to choose r and s, so that we maximize the information 
for a given cost Co per treatment, say. 


We then have 
r(C JR sC,) = Co 


so that the information is 


500 
(C + 80.) (G. an sc?,) 


It is simpler to minimize the reciprocal of this, namely, 


1/69; 
LX (= + Oira + C0 T scu) 
0 8 
and, by differentiating and equating to zero, we get 
Co*, 
— C.. = 0 
g zy 
so that 
Co*, 
n 9 
8 T. (9) 


is the optimum number of samples per plot. This leads to the opti- 
mum value of r: namely, 
Co 
: € 4 ce c 
LI 02. 


In some cases the experimenter may have no choice but to sample the 
experimental unit for the observation of the characteristic: for example, 
if the unit is an apple tree and the characteristic is volume of apple 
(say, number per bushel, or some such measure). In other cases the 
choice may be between the optimum amount of sampling and complete 
harvesting. 

Suppose then that the cost of complete harvesting each plot is Ch. 

` Then, with complete harvesting, the cost is 


r'(C + Ch) 
r 


e. 


and the information is 
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(Note that the component for sampling variation within a plot no 
longer appears in the formula.) The number of replicates possible with 
total cost Co is then C 

0 


Tp, 
and the information per treatment mean is 
Co 
(C + Cy) 
To compare this with the information with optimum sampling we need 
a conversion factor to convert information on a sample basis to infor- 


mation on a plot basis, and we suppose that a plot is equivalent to \ 
samples. To simplify the formula, we denote 


P, 


e. 


by V. Then the relative efficiency of optimum sampling to complete 
harvesting is 


T 


C 
es (0 ＋ 
—— „ (10) 
€ vea (v e v) 


This is a somewhat unmanageable formula, and it is probably better to 
derive the result directly in any particular instance. 

'The following notes may be added to the above. It is usually de- 
sirable to tabulate the efficiencies of various choices of r and s relative 
to some base, as the cost situation may be more complex than the above. 
In the above derivation it was assumed that the population within a 
plot was effectively infinite, so that any finite sampling corrections 
could be ignored. "The reader should refer to Yates and Zacopanay ? 
for further discussion of the problem of sampling replicated experi- 
ments and to Cochran.“ 
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CHAPRER az 


The Sensitivity of Randomized Block 


and Latin Square Experiments 


12.1 INTRODUCTION 


In performing an experiment, the experimenter has two primary ob- 
jects: to test hypotheses, and to estimate parameters. As long as the 
experimenter's interest is in the estit nation of parameters, we have pro- 
vided him with the necessary tools for the planning of his experiment: 
namely, the errors of estimation of the parameters, say, treatment dif- 
ferences, in terms of the number of experimental units, the design, and 
the error variance. We have examined the dependence of the error 
variance on the design and on the type of experimental unit, insofar as 
any general knowledge exists. If any one experiment that we use is 
one of a series of similar experiments, this may satisfy us except for the 
problems of the interpretation of groups of similar experiments, which 
will be taken up in later chapters. In the individual experiment the 
experimenter is likely to be interested not only in the accuracy of his 
estimates but also in the probability or chance he has of proving .the 
existence of treatment differences if they are of a certain size. It is of 
little use to the individual experimenter to reach a “nearly significant" 
conclusion, say, that the effect of a treatment is to produce a response 
of 5 units with a standard error of 3 units. It may be that another 
worker in the field has found a response of, say, 3 units with a standard 
error of 2 units, so that the two investigations appear to indicate a real 
effect. The combination of pieces of knowledge of this sort is, in part, 
a statistical problem to which an answer exists under certain assumptions. 
But also involved in such a combination is the evaluation of the two 
studies, whether in fact they are concerned with the same problem and 


whether the two results may legitimately be pooled. 
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As a simplifieation of the needs of the experimenter, we may suggest 
the curve in Figure 12 for the case of a treatment and a control, in which 
we plot the true difference on the abscissa and the probability of a dif- 
ference being shown to exist on the ordinate. 


100 = 
& 
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True difference 
FIGURE 12. 


The experimenter's rule of action is that he will use a certain test of 
significance, e.g., the 5 percent F test, and, if he obtains a significant 
difference, he will conclude that there is a real treatment difference. If 
the true difference is sufficiently small, the experimenter is not interested 
in concluding that it exists, but, if it is very large, he wishes to have a 
high probability of concluding that a difference exists. Many practical 
experimenters do not think in these terms because to do so requires 
some acquaintance: with statistical notions: e.g., the probability of 
reaching various decisions. One of the important contributions of sta- 
tistics to experimentation is in fact the ability to evaluate a particular 
scientific procedure in the above way. 

We have already considered the question of the sensitivity of an ex- 
periment in Chapter 7. We noted that, if the triangular taste trial is 
used and the experimenter wishes to conclude with probability 0.95 
that there is a difference, when, in fact, the odd one is picked out cor- 
rectly 50 percent of times, a total of 92 repetitions must be used. In 
passing, we may note that a simple problem of this type can be tackled 
experimentally by means of sequential analysis, and the sequential 
method would result in a considerable saving of time (see references 1 
and 2). If, on the other hand, the same reliability of conclusion is 
necessary when the true proportion picked out correctly is 75 percent, 
only 13 repetitions are necessary. Thus, the size of the experiment de- 
pends markedly on the sensitivity we desire. j 

In this chapter we are concerned with the sensitivity of randomized 
block and Latin square experiments. We have based our tests of hy- 
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potheses with these designs on randomization tests, and we should ap- 
proach the question of the sensitivity of these experiments in the same 
way. Operationally we should take a set of data occupying the same 
experimental layout as the design we are to use and similar to the data 
we would get with a uniformity trial. We should then superimpose all 
the possible, N, say, randomization patterns on the design and adjust 
the data according to a set of preassigned treatment effects. For each 
of the N randomizations of treatments, and, therefore, for each of the 
N possible patterns of experimental results we could get, with a set of 
treatment effects, we should determine whether treatments have sig- 
nificant effects by the randomization test. The proportion of the N 
randomizations of treatments that gave significant effects could then be 
obtained, and this proportion could be called the power of the randomi- 
zation test used against the alternative hypothesis with the preassigned 
effects. We can use a randomization test with any significance level 
we choose, and for each chosen significance level, we could, therefore, 
obtain the power of the test against the chosen alternative. We should 
then examine, theoretically at least, the possible alternatives which we 
are interested in discovering, and, supposing the alternatives can be 
mapped in a line (plane, etc.), we would have a power curve (surface, 
etc.). This procedure for obtaining the sensitivity of the randomiza- 
tion test is tedious and somewhat intractable, and so we shall first con- 
sider the infinite model modification. 


12.2 THE POWER OF THE ANALYSIS OF VARIANCE TEST 


We have seen that the randomization test is approximately repre- 
sented by the analysis of variance test, and so we shall discuss the sen- 
sitivity of the randomization test by supposing that not only the null 
hypothesis test but also the distributions under alternative hypotheses 
can be specified by the general linear hypothesis. ¢ 

In Chapter 9 we described Neyman’s approach to the sensitivity of 
the randomized block test for 2 treatments, and we shall now review 
the work of Tang? for the more general case. It is assumed that the 
observations y are expressible as known linear functions of unknown 
parameters plus residuals which are normally and independently dis- 
tributed with mean zero and the same variance c?. This ease includes 
the randomized block experiment in which the yields y;;, i(= 1,2, “+, 7) 
being the block number, and j(= 1, 2, , t) the treatment number, 


are given by 
yg = UH bi t tjt eij (1) 
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u, bi, and tj; being unknown parameters and the e;;’s being normally 
and independently distributed with mean zero and the same unknown 
variance o°. In such a case the results are analyzed by the analysis 
of variance (Table 12.1). 


TABLE 12.1 
Mean 
Due to df Square 
Blocks r—1 
Treatments t-1 P 
Error (r — Dt — 1) E 
Total rt—1 


The experimenter decides on the level of significance he wishes to use 
and compares T/E with the corresponding F value. If the observed 
ratio exceeds the tabulated value he concludes that there are treatment 
differences. 

Under the assumptions of the model, the error sum of squares is dis- 
tributed as x?c?, where x? has (r — 1)(t — 1) degrees of freedom. The 
treatment sum of squares is equal to rZ(y.; — y..)®, and this may be 
expressed in the form : 


T ^ 2 T 
g Ua =y)? + - (ya + y:2 ya) T 


u(t 3 1) ly: t ya b yay 7 (67 Dy (2) 


which we may write as 


214-25 +24 (3) 


Each of the quantities z; is normally distributed with variance c? around 
a mean a; say, and, furthermore, the z;'s are uncorrelated and therefore 
independent. The distribution of Les, may be obtained by one of sev- 
eral methods, the easiest being the use of characteristic functions (see 
Cramer,‘ for example). The method used by Tang was to make a trans- 
formation of variables. It is found that the distribution of 


22, 


ä 


E 


depends on the number of degrees of freedom, t — 1 in this case, which 
is denoted by f, generally, and on 
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say, being 


* Pied 
f(x?) = «> 2 — fom nlx’) (4) 
m=0 M: 


where fom4y,(x) is the density for the ordinary x? distribution with 
2m + f, degrees of freedom. This distribution is known as the non- 
central x? distribution, and is a weighted mean of an infinite number of 
ordinary x? distributions, as equation 4 indicates. Explicitly, the form 
of the distribution is 

* ym e Ax (uam Mn 


12) = 5—^ T. SL tm 
fo) = €^ E ge rs + fO) ©) 

This distribution has some interesting properties, and, in particular, 
is reproductive in that the sum of 2 quantities distributed independently 
according to the non-central x? distribution with parameters M, fı and 
do, fo, respectively, is distributed according to the non-central x? dis- 
tribution with parameters A; + s, ffs The distribution of the 
ratio u of 2 independent non-central x? with parameters M, fı and Xs, f2 
for numerator and denominator, respectively, is found to be (cf. Tang) 


Niger rt alt Mfi-l 


LOL,» 501507 tiis FQ uy FANFA 


j=0 i=0 


(6) 


where B(4f; + i, V + J) is the beta function. We may note that, 
if A, and Ag = 0, we have the ordinary F distribution expressed in terms 
of sums of squares rather than mean squares. We are concerned here 
with the case when Ag is equal to zero, for the error sum of squares di- 
vided by c? is distributed as x^: i.e., & non-central x? with à = 0. The 
distribution of the ratio of the sum of squares for treatments with fi 
degrees of freedom over the sum of squares for error with fo degrees of 
freedom is then 
æ o eith- 


p. — T KD 
f x il BAR +i 3/20 + uy * Amen 


Under the null hypothesis that the treatments have no effect, the 
distribution of u is folu), say, where 
uhi! 


6 
Jolu) BG, Moa ＋ um AFA 


(7) 


(8) 
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The position may be represented by Figure 13. 


| Under null Under alternative 
D a. 
LZ ilm, mm 
i u Uy 
Ficure 13. 


Suppose we have decided to use a 5 percent significance test, then we 
shall reject the null hypothesis if the observed value of u is greater than 
uo, given by P(u > uo) = 0.05: i.e., lies in the portion of the distribu- 
tion under the null hypothesis which is shaded horizontally. We now 
wish to obtain the probability that u is greater than uo under the hy- 
pothesis specified by A: i.e., to find the area in the distribution under 
the alternative hypothesis which is shaded vertically or horizontally. 

The only tables existing are those of Tang“ which are given in the 
Appendix. He chose to work in terms of the quantity E? = u/(1 + u), 
and the tables contain the value of E? which is exceeded by chance in 
5 percent of times, E20 os, and the value which is exceeded by chance 
in 1 percent of times, E?5.9,, under the null hypothesis. These are, of 
course, simple transformations of the corresponding variance ratios P, 


since P = fe u, so that 
á le. 
4 ＋ i 


Furthermore, instead of obtaining the probability of concluding that 
there is in fact a difference, Tang's tables give the probability of failing 
to conclude that there is a difference, Prr: namely, the error of the 


second kind. Also, instead of obtaining Prr as it is related to ^, he ob- 
tained Py for chosen values of 


^ l 2X 
1 ＋ 1 
We shall now give some examples of the use of these tables. 


12.3 RANDOMIZED BLOCKS 


In the case of randomized blocks, f; equals (r — 1) and f; = (r-Dx 
(t 1). The quantity A is equal to rZ(tj — 1)*/2e?, as is easily seen 
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by taking expectation of the z,’s in equation 3, squaring, and adding. 
We find, therefore, that the sensitivity of the randomized block experi- 
ment is a function of the number of replicates, the true error variance 
c?, and the sum of squares about their mean of the true treatment means. 
We now give some examples. 


12.3.1 Randomized Blocks for 2 Treatments 

The case of randomized blocks comparing 2 treatments is simple to 
understand. The following is concerned with testing for a difference, 
and not with the situation discussed in Chapter 9 where one is testing 
whether a chosen one of the treatments is better than the other. In this 
case 
fa - De T = ra — b)? rA 


xn DE 4g? no 


where 
A-—l— 12 
Also 


A 
fi =1 80 $- Vi = Vr and fg=r-—1 
T 


where r is the number of replicates. The probability of concluding 
that there is no difference is, therefore, given by reading Tang’s tables 


with ¢ = VrA/20: i.e., 


— true treatment difference 
Vr * H ĩͤ . I A 
2 true standard deviation per plot 


Let us suppose that the experimenter is interested in detecting a treat- 
ment difference equal to twice the standard deviation per plot, so that 
4/20 = 1 and $ = Vr, and that he will use a 5 percent significance 
test. For various values of r we find the data in Table 12.2. 


TasLE 12.2 

Pu 

r h „ (Approximate) 
3 2 1.73 0.71 
5 4 2.24 0.34 
7 6 2.65 0.13 
9 8 3.00 0.04 
11 10 3.32 0.03 
16 15 4.00 0.01 
31 30 5.57 0.01 
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So, if the experimenter wishes to have a 90 percent chance of conclud- 
ing by a 5 percent test that there is a difference, when the true difference 
is twice the standard deviation per plot, he should use about 8 replicates 
(Pu = 0.08). 

We now consider the case when a 1 percent significance test is used 
(Table 12.3). 


TABLE 12.3 
Pu 
r fa $ (Approximate) 
3 2 1.73 0.93 
5 4 2.24 0.72 
7 6 2.65 0.44 
9 8 3.00 0.22 
11 10 3.32 0.09 
16 15 4.00 0.01 
31 30 5.57 0.001 


It should be noted that the use of a test that rejects the null hypoth- 
esis less frequently when it is true also results in the less frequent rejec- 
tion of the null hypothesis when an alternative is true. In order that 
the probability of concluding by a 1 percent test that there is a treat- 
ment difference be 96 percent, about 12 replicates are necessary, as op- 
posed to 8 for the 5 percent test. 

The values of Pr; for various values of A/s and r have been obtained 
and are given in Table 12.4. 


TABLE 12.4 SENSITIVITY or RANDOMIZED BLOCK EXPERIMENT FOR 2 TREATMENTS 


Approximate 
N A/e 
ES C EAN 
5% Test 1% Test 
r 14 1 2 by 1 2 
3 0.93 0.85 0.71 0.98 0.96 0.93 
5 0.90 0.76 0.34 0.98 0.93 0.72 
7 0.06 0.64 0.13 0.97 20.87 0.44 
9 0.83 0.54 0.04 0.95 0.81 0,22 
11 0.80 0.43 0.03 0.93 0.72 0.05 
16 0.74 0.25 0.001 0.90 0.52 0.01 
31 0.52 0.03 0.001 0.75 0.13 0.001 
64 0.01 0.43 
144 0.05 


It is clear from Table 12.4 that the use of a 5 percent or a 1 percent 
test, when the difference to be detected is of the order of half the stand- 
ard deviation per plot, will lead to an acceptance of the null hypothesis 
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in an inordinately high frequency of cases with the number of replicates 
usually considered, say, up to 20. If the experimenter cannot use more 
than this number of replicates, it would appear advisable to use perhaps 
a 10 percent significance test. 

The most important conclusion from Table 12.4 is that the experi- 
menter will have great difficulty with up to 20 replicates in showing 
the existence of a difference A which is less than or equal to the standard 
deviation per plot. This is the most potent reason for the reduction of 
a°, for a given A, if the plot variance c? can be reduced by a factor of 
4, say, by the choice of experimental unit, the experiment will have 
much more value to the individual experimenter than would be indi- 
cated merely by the relative information: namely, 4. 


12.3.0 The General Case 

For the general case of ¢ treatments, the degrees of freedom fı for 
treatments is equal to (t 1) and for error is (r — 1)(t — 1. The 
quantity \ is given by 


T 
Xx = = Xt; — D? 
2720 


where ¢; is the true treatment mean. It is a simple matter to obtain 


the sensitivity of any experiment. 
For an example, let us suppose that we have 5 treatments and that 
the true treatment means expressed about zero and in terms of the 


standard deviation are 
—2, —1, 0, 1, 2 


Then, 
F; 
à = (io) = 5r 
20 ) 


| 5 
2 2) ir 2X D ee dr 
11 ＋ 1 5 


Using Tang’s tables, we find the data in Table 12.5. 


and 


Taste 12.5 
Py (Approximate) 


5% Test 1% Test 
0.47 0.82 


(RON + 
res 
E 
o 
g 
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Thus, in this situation, at least 3 (4) replicates are necessary if the 
experimenter is using a 5 percent (1 percent) significance test and de- 
sires a 90 percent chance of showing that there are treatment effects, 
when the true treatment effects are as specified above. 

'The true treatment effects we have considered are perhaps somewhat 
large for most experimental situations, for we have said that the best 
and worst treatments differ by 4 times the standard deviation per plot. 
If, instead, we take the ease — 1, —0.5, 0, 0.5, 1 as the true treatment 
deviations in terms of the standard deviation per plot, we have 


= (25 = 650 f 
24099. $- poete 2 


For this case, we find the data in Table 12.6. 


TanL& 12.6 
Py (Approximate) 


T 5% Test 1% Test 


4 0.33 0.76 
8 0.07 0.23 
10 0.05 0.12 
12 0.01 0.05 


The experimenter will, therefore, need of the order of 8 or 10 repli- 
cates for adequate sensitivity. The general conclusion which might be 
drawn from this examination is that, with the smaller numbers of rep- 
licates, ‘a 5 percent or 1 percent test, i.e., a test with a type-I error of 
5 percent or 1 percent, is too strong in that it will very frequently re- 
sult in the non-rejection of the null hypothesis when another hypothesis 
in fact holds: ie. in a type-II error. It is rather difficult, however, to 
make a stronger statement, because the situation can only be repre- 
sented in terms of type-I errors which may be fixed arbitrarily by choice 
of significance level and type-II errors which depend on the number of 
replicates and on the true treatment differences. In certain cases, the 
experimenter can possibly attach weights to the two types of error, 
though this will be difficult in any but a technological experiment. It 
is clear, however, that, if the experiment to be performed is not one of 
a series of similar experiments, Tang’s tables should be used to enable 
a judgment as to whether it is worth while at all, in view of the experi- 
menter’s aims and resources for the experiment. If an experimenter is 
interested in discovering a certain magnitude of treatment effect and 
the resources he can use give him only, say, a 20 percent chance of con- 
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cluding that there are treatment effects, when the true effects are of the 
chosen magnitude, there seems little point in the experimenter's doing 
the experiment. He would, under these circumstances, be well advised 
to choose a topic less expensive of his resources than the one under con- 
sideration. 


12.3.3 Single Degree of Freedom Contrasts in Randomized Blocks 
Usually in the randomized block experiment with several treatments, 
the experimenter has in mind certain single degree of freedom contrasts 
among the treatments that he believes to be important. For this situ- 
ation the tables of Tang for fı = 1 and f; = the number of degrees of 
freedom for error should be consulted. Actually, for given &, the change 
of Pr with the number of degrees of freedom for error (if not less than 
12, say) is not great although it is consistent. The value of ¢ will 
depend on the true contrast, and, if we suppose this is equal to A, then, 


and 


so that we are back with the case of randomized blocks of 2 plots except 
that we have (r 1) (f — 1) degrees of freedom for error. For most 
purposes we may use the value for fa of 60 and suppose that a 5 percent 
test will be used. If, then, the size of the experiment is to be such that 
the experimenter is to have a 95 percent change of discovering an effect, 
when it is of size A, we must have approximately — 


Pl 
r > 229) 25 


or 3 
g 
r2 Ws 
To have a chance of 80 percent or more of discovering an effect when 
it is of size A, we must have 


ie., " 
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For a 50 percent chance of discovering an effect in the same situation, 
we must have approximately 


"These 3 rules on the number of replicates necessary will be satisfactory 
for most purposes. 

As a variation on the above, consider the testing of 5 rates of a stimu- 
lus, say, 0, 1, 2, 3, 4 units, and suppose that the experimenter wishes 
to conclude by a 5 percent test that there is a linear regression of yield 
on dose when the true regression is 8. Then, 


r 108? 


8 


22 vor 


We have, therefore, that, if a 50 percent, 80 percent, and 95 percent 
probability is required of deciding that there is a linear regression of 
dose on stimulus, r must be greater than 


50% 802 14% 
108 10% 1065 


respectively. If the required number of replicates cannot be per- 
formed, the experimenter should consider the possibility of the linear 
regression holding over a greater range of rates. If this could be as- 
sumed, and if, instead of the above, rates of 0, 2, 4, 6, 8 units are used, 
the number of replicates would be \ of those stated. 


124 LATIN SQUARES 
For the Latin square for £ treatments we have fi = - 1, fo = 


"EN cl. — D. 2) zü- 0)? 
( — 0e 2), N 2 uad ġ= =- . 


It is a routine matter to consult Tang's tables, and, as an example, we 
consider the case of 5 treatments with means —2, —1,0, 1, 2 in units of 
standard deviation ø. The quantity ¢ is then V10 = 3.16 and f; = 12 
so that, with a 5 percent test, Prr is less than 0.001, and, with a 1 percent 
test, Pi; is about 0.035. 
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12.5 COMPARISON OF RANDOMIZED BLOCKS WITH 
LATIN SQUARES 


As we saw in earlier chapters, the Latin square tends to give more 
information than the randomized block layout, because the error vari- 
ance will usually be less and cannot be greater than in the latter case. 
In this statement we have used information in the technical sense of 
reciprocal of variance, and were, therefore, thinking primarily of esti- 
mation. It is not true that Latin squares are always better than ran- 
domized blocks from the point of view of sensitivity. The example we 
discussed for both randomized blocks and Latin squares is a case in 
which the reduction of degrees of freedom for error concomitant with 
the Latin square design results in a lowering of sensitivity unless ac- 
companied by a decrease in c? and, therefore, an increase in À. Given 
a large set of uniformity data on the material under experiment, we 
could estimate the values of c? for the designs and, hence, obtain À for 
a given set of treatment effects. It would then be possible to make a 
true comparison of the sensitivity of the two designs. 

In general, howeyer, such a comparison seems somewhat academic 
in that, even from the point of view of estimation, we take account in 
an intuitive way of the number of degrees of freedom for error and 
would not use the Latin square unless we have, say, 12 or more degrees 
of freedom for error. The circumstances under which we would con- 
sider the 4 X 4 Latin square with only 4 (not a multiple of 4) replicates, 
and, hence, 6 degrees of freedom for error, for the comparison of 4 
treatments would only be for answering questions about a large popu- 
lation. In this case the experimental material would be arranged in 
strata and 2 or more experiments would be conducted in each stratum. 
From the point of view of answering questions about the population, 
there are 2 variances: namely, the error variance and the variance of 
true treatment differences from experiment to experiment within a 
stratum. One is not primarily concerned with the sensitivity of the 
individual experiment, and the gain in accuracy of the estimate for the 
whole population from the use of individual Latin squares may be worth 
while. 

There seems little doubt that Latin square designs of side 5 or more 
are better than randomized blocks of the same size, if the model for 
the Latin square can be assumed to hold, for the change in Py with 
change in error degrees of freedom will not be large enough to compen- 
sate for the change in the error variance c?. As we have seen already, 
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the larger Latin squares, say, with side greater than 8, tend to be of 
little value for field experiments and probably for most other types of 
experiment also. If the number of replicates contemplated for the tests 
involving 4 treatments is such that 2 or more Latin squares may be 
used, again there seems little doubt that the Latin square is to be pre- 
ferred, though it is necessary to consider the extent to which the Latin 
square will result in a reduction of o°. If the reduction will be only 
slight for the type of experimental material under investigation, ran- 
domized blocks would be preferred. 


12.0 THE VALIDITY OF THE INFINITE MODEL APPROACH 


We noted in Chapter 7 that the F distribution may be expected to 
represent quite closely the distribution over possible randomizations of 
the criterion 


Treatment mean square 


Error mean square 


regardless of the yield figures subjected to the analysis. This distribu- 
tion will be approximately the same for all additions to the basic yields 
of treatment effects, according to any randomization pattern. It 
may, therefore, strike the reader as a little odd that we introduce 
the non-central F distribution to indicate the sensitivity of the ex- 
periment. 

To examine the sensitivity of an experiment according to randomiza- 
tion tests, we may suppose that we are dealing with a randomized ex- 
periment on ¢ treatments in r randomized blocks and that we have avail- 
able the yield for each plot which we would obtain in the absence of 
treatment effects. We may choose a set of treatment effects, and, for 
each of the (ti)? possible randomizations, we may superimpose the treat- 
ment effects, giving (t.)“ sets of yield data, say, Yi, Yo,+-+,¥v,N = 
(L)'. Each set of yield data is then examined by the randomization 
test for significance of treatment effects at a chosen significance level. 
If a p percent significance test is used, the treatment effects will be 
stated to exist, if a proportion p or less of the randomizations gives a 
value for the criterion greater than or equal to that given by the par- 
ticular randomization according to which the treatments were applied. 
The proportion of treatment patterns that show the treatment effects 
to exist is the relevant measure of the sensitivity of the experiment. 
To carry out an examination in this way, we need to take a set of uni- 
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formity data and for each set of treatment effects prepare an N X N 


table (Table 12.7). 
Taste 12.7 


Value of Criterion for Randomizations 

Treatments Applied of Yields 
according to 

Randomization No. 


1 

2 

3 
N 


Such a procedure is impossible, in view of the amount of computation 
that would be necessary, nor, so far as we know, has a mathematical 
solution to the problem been obtained. 

It seems intuitively that the following statements are true: 


1. The treatment sum of squares is distributed over the randomiza- 
tions for a given set of yields, approximately as xo, where x! is dis- 
tributed according to the central x” distribution. 

2. The error sum of squares is distributed approximately as x 
(though we have evidence that this is not quite the case). 

3. The treatment sum of squares for the randomization pattern ac- 
cording to which treatments are applied is distributed over randomiza- 
tions approximately as x02, where x” is distributed according to the 
non-central x? distribution: and, to support this statement, we may 
point out that the treatment sum of squares is equal to the sum of 
squares among a set of t variables, each variable being made up of a 
random variable, which is subject to constant variance, plus a fixed 
variable: namely, the treatment effect. , 
reumstances and with independence, we would get the 
distribution which we used earlier in the chapter. It 
certain that the non-central F distribution can be 


Under these ci 
non-central F 
also seems fairly 
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used for experiments with large blocks, for the correlation between 
plot errors within a block is —1/(k — 1), where k is the size of block. 
It is, however, difficult to say more about the matter. 

To shed some light on the problem, an example has been worked 
through as outlined above. The case considered was the comparison 
of 2 treatments on 8 plots whose yields with a uniform treatment (around 
an arbitrary base) were 6, 4, 7, 2, 1, 8, 3, 5. There are 70 possible ran- 
domization patterns for applying each treatment to 4 plots, and all 70 
possible yield patterns with true treatment differences A equal to 0, 2, 
4, 6, 8, and 10 units were considered. Each yield pattern was examined 
by the randomization test, 


Treatment mean square 


Error mean square 


being used as the criterion. The proportion of the 70 possible randomi- 
zations for treatments that gave a significant treatment effect at a sig- 
nificance level of 245 (= 5.72%) was obtained. This proportion is com- 
pared in Table 12.8 with the proportion significant using a 5 percent F 
test and the proportion expected to be significant from Tang’s tables. 


Taste 12.8 Tun VALIDITY or THE F Test AND THE SENSITIVITY OF THE 


^ EXPERIMENT 
Percentage Significant 

By Random- Expected from 
True ization Test: By F Test: Tang's Tables 
Treatment Significance Significance (Approximate) 
Difference Level: 5.72% Level: 5% with a 5% Test 

0 5.7 5.7 5 

2 7.1 10.0 18 

4 34.3 34.3 53 

6 81.4 82.9 86 

8 100.0 100.0 97 

10 100.0 100.0 100 


As a by-product of this examination, we may note how closely the 
proportions significant by the randomization test and by the use of the 
F distribution agree even with as small an experiment as the one con- 
sidered. The example, however, indicates that Tang’s tables may give 
some inflation of the proportion significant over what was actually ob- 
tained. This inflation occurs in a range that may be important to ex- 
perimenters. From some points of view, this might be expected in 
that, according to general linear hypothesis theory, new random vari- 
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ables for the base yields are chosen with each repetition, but there ap- 
pears to be no simple reason for a deviation in one direction rather than 
another. 

We may conclude then by stating that Tang’s tables may be used to 
give an indication of the sensitivity of experiments with respect to the 
randomization test, but, in the case of small experiments, we cannot 
claim, in the present state of knowledge, that the indication is other 
than an approximate one. 


REFERENCES 


. Warp, A. Sequential analysis. John Wiley & Sons, New York. 1947. 

2. Freeman, H. A., Frrepman, M., MosTELLER, F., and WaLIIs, W. A. Sampling 
inspection. McGraw-Hill, New York. 1948. 

3. Tana, P. C. The power function of the analysis of variance tests with e 
and illustrations of their use. Stat. Res. Mem., 2, 126-149, 1938. 

4. CnAMÉn, H. Mathematical methods of statistics. Princeton University Press, 

Princeton. 1946. 


— 


GUIDAPPER L3 


Experiments Involving Several Factors 


131 INTRODUCTION 


So far we have considered the testing of a number of treatments, not 
necessarily related to each other, in randomized blocks or Latin squares: 
for example, varieties or fertilizer treatments. Frequently we know that 
several faetors may affect the characteristie in which we are interested, 
and we wish to estimate the effects of each of the factors and how the 
effect of one factor varies over the levels of other factors. For example, 
the yields of most agricultural crops are affected by three plant nutri- 
ents, nitrogen n, phosphate p, and potash k. Given a population of ex- 
perimental units, we may ask what is the effect of imposing nitrogen, 
what is the effect of adding nitrogen after the addition of phosphate, and 
so on. One experimental procedure would be to estimate the effect of ni- 
trogen keeping all the other factors at a constant level in one experiment; 
the effect of nitrogen after phosphate is added, keeping the remaining fac- 
tors constant; and so on. This procedure would generally be used when 
the purpose is to establish a fundamental law, for we have no reason to ex- 
pect the law to be of a simple form nor the other factors to have simple 
effects. If we allowed all the factors to vary at will or according to some 
chosen scheme, it would probably be impossible to establish the law be- 
cause of the various possible interactions of the factors. The experi- 
menter would be advised, once he has decided which factors are im- 
portant, to apply them one at a time, at least until he has formulated a 
law for the effects of any one of the factors. 

Another experimental procedure would be to vary each of the factors 
and to estimate the characteristic for each combination of the factors. 
This procedure has much to recommend it at the beginning of an inves- 
tigation to suggest possible response relations and to solve many tech- 
nological problems, for in these situations the experimenter does not 
know which factors are important or whether each factor exerts its effect. 
independently of the other factors. The previous procedure would lead 
to detailed knowledge of the effect of one factor when the others were 

234 


THE CASE OF 2 FACTORS 235 


held constant but would give no information at all on the dependence 
of the effect of the factor on the levels at which the other factors were 
held constant. It, therefore, provides, on its own, information of little 
general value. 

The choice between the two procedures is largely a question of the 
nature and stage of the research. If the research is of the technological 
type, that we wish to determine the effect of particular amounts of 
nitrogen, phosphates, and potash on the yield of corn in Iowa, for ex- 
ample, we should test all of the treatment combinations. If the research 
is of the fundamental type, dealing with the formulation of laws and 
the prediction of effects, we should first determine which factors are im- 
portant and the degree of the interdependence of their effects and then 
isolate some of the factors for detailed study and return to the general 
problem when laws have been formulated. The distinction made above 
is somewhat artificial but is of value in the formulation of a research 
program. 


13.2 EFFECTS AND INTERACTIONS 


13.2.1 The Case of 2 Factors 

We test the 4 combinations of 2 factors each at 2 levels, say, nitrogen 
at levels no and n; and phosphates at levels po and pı. The 4 treatment 
combinations may be represented as 


Topo 
npo 
nop 
nip 


We can estimate the effect, of increasing nitrogen from no to n; at each 
of the 2 levels of phosphate. If yields are represented by the treatment 


symbols we have 


Effect of nitrogen at level po = "1po — nopo 


Effect of nitrogen at level p; = "ipi — Nopi 

As an approximation to the effect of nitrogen, we may obtain an average 
effect which we denote by N, 

N = (npr — nopi + ipo — nopo) (1) 


or 


N = 10 — no) + Po) 
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where the expression is to be expanded algebraically and the yields sub- 
stituted for the treatment symbols. 

If the 2 factors were acting independently we would expect the 2 ef- 
fects, at levels po and pi, to be equal, but, in general, they will be differ- 
ent, and their difference is a measure of the extent to which the factors 
interact. For convenience we take half the difference of the effect at 
level pi and the effect at level po and denote it by NP, thus, 

NP = 3 (mp1 — nopi — "ipo + nopo) = 31 — no)(pı Po) (2) 

In the same way we may obtain the effect of phosphate, 

At level no of nitrogen, "opi — nopo 
At level n; of nitrogen, nip; — "ipo 


The average of these two is the average effect of phosphate denoted 
by P, 
P = (mpi — mpo + opi — nopo) = $(nı + no) (p — po) (3) 
The interaction of phosphate with nitrogen we would obtain as before, 
3 (effect of p at level n, — effect of p at level ng) 
which equals 
PN = 3(mPi — npo — nopi + nopo) 


and we see that this is the same as the interaction of nitrogen with phos- 
phate NP, so that we need not bother about the order in which we write 
down the letters. 

We note that the effects and interaction are 3 mutually orthogonal 
contrasts of the yields of the 4 treatment combinations: 


Tipi "po Nnopı nopo 


2N R X — - 
2P t+ - 4 = 
SNP, ode. o + 


If we denote the mean yield of the 4 treatment combinations by M 
we have the transformation of the yields represented by 


4M 1 1 1 1] [mips 
IN EE O EEA ae 
W III (4) 
WPI III 
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The matrix of the transformation is orthogonal except that it is not 
normalized. 
This relationship may be inverted, giving 


mpi = M + 3N + ÀP + NP 
npo = M + IV- 3P — 4NP 
nop: = M — 4N + 3P — 3NP 
nopo = M — 4N — 4P + NP 
1 1 11[2M 


[ee 1 

nipo 1 1-110541 N 

nopi 1 -1 1 21 E 
1 1 NP. 


(5) 


Nopo 


It should be noted that we have used the convention that treatment 
combinations are represented by lower-case letters and effects and inter- 
actions by capitals. This convention is valuable in many ways and 
should be adhered to strictly to prevent confusion. 


13.2.2 The Case of 3 Factors 
Suppose that we wish to determine the increase in yield on corn 

brought about by increasing the dose of nitrogen from no to nı, of phos- 
phates from po to pı, and of potash from ko to kı. We test all the treat- 
ment combinations of which there will be 8 (= 2 X 2 X 2), namely: 

nopoko 

n3 poko 

nopiko . 

mprko 

nopokı 

ni poki 

np 

np 


The order in which these are written is a standard order which is valu- 


able from many points of view. Tap 
Suppose we determine the yields of each of these combinations with- 


out error and denote the yield by the same symbol as the treatment. 
The effect of increasing the nitrogen from no to n, is given in Table 


\ 
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13.1, the yields of the treatment combinations again being denoted by 
their symbols. 


TABLE 13.1 
Level 

Level of p of k Effect of Nitrogen 
Po ko nypoko — nopoko 
n ko nipiky — nopiko 
Po kı nipoky — op 
pı kı bi — nopıkı 
Mean effect of n 1 (Sum of above) 


The effect of nitrogen will depend on the level of the other factors, 
and there are then the above 4 effects. If we take the mean of these 4 
differences, we obtain what is termed the average effect of nitrogen, de- 
noted by N. We can average the differences we obtained above over 
the levels of potash, for each level of phosphate, giving 


Effect of nitrogen, at po, mean of ko and ky = d (nipoko — nopoko 
+ ny poly — nopok;) 
Effect of nitrogen, at pı, mean of ko and ky = 3(mypiko — nopiko 
Tonpk — nopihi) 
These 2 effects will, in general, be different, and V5 of the lower minus 
the upper one is called the interaction of nitrogen and phosphate and is 
denoted by NP. We can represent this formally by the expression 
NP = A — no(pi — po)(ki + ko) (6) 
in which we expand the expression algebraically and substitute the yields. 
We can also evaluate the interaction of nitrogen and phosphate at 
each level of potash, thus, 
At level ko of potash $(nipiko + nopoko — nipoko — nopiko) 
At level kı of potash J(nipil, + nopok, — Ny Poky — nopyky) 


The average of these 2 quantities is the interaction NP above. The 2 
interactions may be different, and, as a measure of the extent to which 
they are different, we form Ig of the interaction of nitrogen and phos- 


phate at the upper level of potash minus that at the lower level, giving 
the 3-factor interaction, 


NPK = i(npik + nopok, — nip, — noprky 


— "ipiko — nopoko + nipoko + nopiko (7) 
This may be represented formally by the expression 


NPK = A = no)(pı — po) (ky — ko) 


THE CASE OF 3 FACTORS 239 


and this symbolism shows that it is also the interaction of the interaction 
NK with phosphate, and so on. I 

As in the 2-factor case, we denote the mean yield of the 8 treatment 
combinations by M. 

Corresponding to this definition of mean and effects and interactions, 
we have the following expression for the yield of a treatment combina- 
tion, 
2n,p,k, = 2M + (C1) 1N + (1) 

zi: (—1)-»*e-b»Iyp $ (-K ix (—1)¢- 9+ DINK 
a (—1)6-»*e-Ulpk + (—1)6-D*6-Dt(-Uypye (8) 
where the possible values for each subscript r, s, and t are zero and unity. 

We may condense the symbols for the treatment combinations by re- 
placing no, po, ko by unity and nı, Pı, kı by n, p, k, respectively. In this 
way the symbol pk, for example, represents nitrogen at the lower level, 
and phosphate and potash at the upper levels. We denote by (1) the 
treatment combination for which all the factors are at the lower level. 
We have then definitions of effects and interactions exemplified by 

N = í(n — D + D(E + 1) 

NP = i(n— 1)(p — 1)(k + 1) 

NPK = 40 — 1)(p - 1)(k — J) 
a minus sign appearing in any factor on the right if the letter is present 
on the left. Note the importance of the cọnvention of using small let- 
ters for treatment combinations and large letters for effects and inter- 


actions. Without it there would be hopeless confusion for most people. 
The effects and interactions are a transformation of the yields shown in 


Table 13.2. 
Taste 13.2 


(0 n p np k nk pk npk 

1 1 1 1 

4N -1 1211 1 1 -1 
1 
1 


4NK ö 


1 
1 
1 
1 

Jeep m pu x 1 
1 

4PK ri 

1 
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This matrix of numbers is simply construeted: we have adopted the 
standard order for the treatment symbols and the effect, symbols, and 
the numbers for N, P, and K are easily written down, being +1 if the 
corresponding small letter is present and —1 if absent. The numbers 
for any combination of letters, say, NP, are the product of the corre- 
sponding numbers for N and P and so on. ó 


13.2.3 The General Case 


With n factors a, b, c, d, e, etc., the effects and interactions may be 
represented by 


X= T + 1)(b + 1)(c & I) (d & 1)(e & 1) , (9) 


where the sign in each bracket is positive if the corresponding capital 
letter is not contained in X and negative if it is contained in X, and the 
whole expression on the right-hand side is to be expanded algebraically 
and yields are to be substituted in place of the corresponding treatment 
combination. 

The yield of a treatment combination is best written down by writing 
the treatment combination as ajbjc, *** ete., where absence is denoted 
by the subscript taking the value zero, and presence by the subscript 
taking the value unity. Then 


2ajbjc, = 2M & A +B A AB +C x AC, ete. (10) 
where the sign 
On A is —1ifi=0, +1lifi=1 
On Bis —1ifj20, 41 if = 1 
and so on 


and the sign on a term involving several letters is the product of the 
signs on the individual letters. 


13.3 THE INTERPRETATION OF EFFECTS AND 
INTERACTIONS 


The interpretation of effects and interactions follows closely from the 
definitions. The main effect N is the effect of increasing nitrogen from 
amount no to amount n; (or from the basic amount to amount n), aver- 
aging over all the possible combinations of p and k, phosphate and 
potash. 

Now suppose we wish to obtain the effect of nitrogen, averaging over 
presence and absence of phosphate, but in the absence of potash (i.e., 
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at the basal level ko). In terms of treatment combinations this is equal 
t 

fi lap — p +n- (I) 


the divisor of 2 being used because we wish the effects to be on the basis 
of differences on a single plot. This is equal to 


- V- VNR 
for 
N = AI — D(p D 
and 
NK = k(n — 1)(p + Dk — 1) 
so that 


V= NK = dn — Up *-DlE + 1 — (k — 0] 
a(n — 1)(p + 1) 
which equals, on expansion, 

dnp - p+n— (Q0 


In a similar way we obtain the following: 


Effect of n, averaging over levels of p, k present = N + NK 
Effect of n, p absent, averaging over levels of k = N—NP 
Effect of n, p present, averaging over levels of k= N -- NP 
Effect of n, p present, k present — N+NP+NK+NPK 
Effect of n, p present, k absent = N+NP-NK-NPK 
These expressions may be written down formally as 
N(1 + K) 
N( - P) 
N( + P) 
N(1 4- P) t K) 
N(1 + P) — K) 


ves an easy way of remembering them and of writing down 


and this gi 
Y y situation with regard to the other 


the effect of any one factor for an, 
factors. 


13.4 A SIMPLE EXAMPLE OF A FACTORIAL EXPERIMENT 


So far we have considered only the breakdown of the treatments into 


a set of orthogonal contrasts which have practical utility. Thus with 4 
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treatments, (1), n, p, and np, say, we have the 3 mutually orthogonal 
contrasts (Table 13.3). 


Tasi 13.3 
Contrast (I) n p np 
N - + = + 
P — — T T 
NP T - = F 


These contrasts have been defined for the true yields under a partic- 
ular set of circumstances. When we test the treatment combinations, 
we shall obtain estimates of the true yields, rather than the true yields 
themselves. In order to obtain estimates of the true effects and inter- 
actions, we utilize the fact that, under additivity, the observed yields 
will be given by a general linear hypothesis model as, for example, 


yj = u + bi + tj + eij (Randomized blocks) 
or 


Vk = u + Ti + cj + te + eijk (Latin squares) 


that is, in which the observed yield is made up additively of components 
for positional effects plus a treatment effect plus an error effect. Under 
the finite model we use for randomized blocks, the true yield of treat- 
ment j in block 7 is u + b; + tj, and only the £;'s enter into the effects 
and interactions. We know also that the best estimate of a linear con- 
trast among the treatments is the same linear contrast of the estimates 
of the treatment effects. For randomized blocks or Latin squares, for 
_which no observations are missing, the best estimate of any treatment 
contrast is given by the same contrast of the treatment means. So far 
then, we use the factorial scheme as giving us a valuable breakdown of 
the treatment effects and sum of squares. 
A simple factorial experiment is given in Table 13.4. 


TABLE 13.4 POTATOES: EFFECT or INORGANIC AND ORGANIC FERTILIZERS ! 


Variety: King Edward 

System of replication: Latin square 

Area of each plot: 460 acre 

"Treatments: 
1 = blood, superphosphate 
2 = sulphate of ammonia, superphosphate 
3 = sulphate of ammonia, steamed bone flour 
4 = blood, steamed bone flour 

Rates: 0.5 cwt N and 0.6 cwt P105 per acre. All 
plots received sulphate of potash at the rate 
of 1.25 cwt KsO per acre 
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TABLE 13.4 POTATOES: EFFECT or INORGANIC AND ORGANIC VERTILIZERS ! 
(Continued) 
Actual Weights in Pounds 


Row 


The treatments have a factorial structure: 
n, say: Blood (no) or sulphate of ammonia (n) 
p, say: Superphosphate (po) or steamed bone flour (pi) 


The designations no, 71, Po, and pi are arbitrary: i.e., no is not neces- 
sarily the lower level of n, etc. 
The analysis of variance is given in Table 13.5. 


TABLE 13.5 ANALYSIS OF VARIANCE FOR EXPERIMENT or TABLE 13.4 


Sum of Mean 
Due to df Squares Square 
Rows 3 7,285.2 
Columns 3 1,515.2 
Treatments 3 44,462.2 14,820.7 
Error 6 4,649.1 774.8 
Total 15 57,911.7 
The treatment totals are: 
nopo : 2987 
npo : 2503 
nopi : 2444 
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The effects are then estimated by 
N = —2987 + 2503 — 2444 + 2624 = —304 
P = —2987 — 2503 + 2444 + 2624 = —422 
NP = 2987 — 2503 — 2444 + 2624 = +664 
To convert these totals to estimates of effects on the basis of a single 
plot, it is necessary-to divide by 8 [= 4 (= no. of reps) X 2] giving 
= —38.00 
= —52.75 
NP = 83.00 
We have estimated the error variance per plot to be 774.8, and the vari- 
ance of each effect and interaction is estimated by 14 X 774.8 = 193.7 
= (13.9)?, so that to each estimate we may attach a standard error of 
13.9 and test each with the ż test with 6 degrees of freedom, the number 
of degrees of freedom on which the error is based. 
The divisor of 4 in 482, s? being the estimated error variance, is ob- 


tained by noting that the estimate of each effect and interaction is 
equal to f 


tl 


Gum of 8 plots — sum of 8 plots) 


so that the true variance is equal to 
1 1 
85 (8 + 8e? = i 


and we substitute s? for c?. 

Alternatively, we may obtain a sum of squares for each effect and 
interaction by squaring the total effect and dividing by 16 (the sum of 
mii of the coefficients of plot yields in the estimating expression), 
thus: ; ‘ 


Sum of squares for N. = (—304)?/16 = 5,776.00 

Sum of squares for P (—422)?/16 = 11,130.25 

(664)?/16 = 27,556.00 

The sum of these 3 sums of squares is, of course, equal to the total sum 
of squares for treatments, and we may test each sum of squares against 
the error mean square using the F test with 1 and 6 degrees of freedom. 
The test of significance for each effect and interaction in this way is the 
same as the ¢ test given above, because F with 1 degree of freedom and 
n, degrees of freedom is equal to the square of t with nı degrees of free- 
dom, at the same level of significance. The statistical interpretation of 


U 


Sum of squares for NP 
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the experiment is simple, that there is some evidence of an average n 
effect or difference between blood and sulphate of ammonia; there is an 
average effect of p, or difference between superphosphate and steamed 
bone flour, which is significant at about the 1 in 100 level; and there is 
an interaction which is significant at a somewhat higher level (about 
0.001).* We ignore the correlation between these tests of significance; 
its effect in as small an experiment as this is possibly appreciable, but 
it decreases with increasing number of degrees of freedom on which the 
error is based. It should be noted that, if the experiment is arranged 
in randomized blocks, it is possible to estimate the error independently 
for each effect and interaction when each treatment combination is repre- 
sented at least, twice in the experiment. If this were done, the correla- 
tion between tests would be removed, but, in general, the assumption 
that the errors are homogeneous will be a valid one, and there would 
result a loss in sensitivity for each test from the reduced number of 
degrees of freedom on which each error estimate would be based. This 
is not possible with the Latin square, as has been mentioned previously. 


Finally we have the following condensation of the results: 


Difference (blood — sulphate of ammonia) on 


the average =N = —38.00 


Difference (blood — sulphate of ammonia) with 


superphosphate = N — NP = —121.00 


Difference (blood — sulphate of ammonia) with 
steamed bone flour 


Difference (sbf — superphosphate) on the aver- 
=P —52.75 


= P — NP = 135.75 


age 
Difference (sbf — superphosphate) with blood 
Difference (sbf — superphosphate) with sul- 


phate of ammonia PTM = 30.25 


13.5 THE GENERAL CASE OF SEVERAL FACTORS EACH 
AT 2 LEVELS 
b, c, d, e, ++, each with 2 levels, and in 


we have factors a. e 
Me. tion we include each letter if the cor- 


designating any treatment combina: 
* We have used the conventional F test, though this is perhaps not desirable 


(cf. Chapter 10). 
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responding factor is at the upper level. The treatment combinations 
may then be written out in order, as shown in Table 13.6. 


Taste 13.6 
(1) d e de 
a ad ae ade 
b bd be bde. 
ab abd abe abde etc. 
c ed ce cde 
ac acd ace acde 
bc bed bce bede 
abe abed abce abede 


We may enumerate the effects and interactions in the same way 
(Table 13.7). 


Taste 13.7 
Number 
Main effects n 


n(n — 1) 
2 
n(n — 1)(n — 2) 
n(n — 1)(n — 2)(n — 3) 


2-factor interactions 


3-factor interactions 


4-factor interactions 


Total 2" 1 


The effects and interactions are exemplified by 


A= T t ac 1)(b + De I)(d + 1)(e + 1) «++ ete. 


1 
AB = r^ (a — 1)(b — De D(d + D(e 1) «+ 


ABC = X age D = He D(d + e + ) «e 


ABCD = —~ (a — 1)(b — De- 1)(d — e +1) --- 


ete. 
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If the interaction XYZ ..., where X, Y, Z +++ are each one of the 
letters A, B, C, D.., contains an odd (even) number of letters, it is 
given by the mean of the treatment combinations with an odd (even) 
number of letters in common with XYZ ., minus the mean of the 
combinations with an even (odd) number of letters in common with 
XYZ. . (zero being regarded as an even number). 

For example, in a 2* factorial experiment we may write down imme- 
diately the expressions given in Table 13.8. The 2-factor interactions 


TaBLE 13.8 


Y ields of Treatment Combinations 


Effects and 
Interactions 


8BCD 


8AB 


8ABCD 


E | E 


are regarded as the interaction of 2 main effects in the following way. 
The plots are divided into + groups on the basis of the table: 


For A 


the plots in cell 1 being (1), c, d, and cd in the case of a 2* factorial ex- 
periment. Then the interaction AB is equal to 


55 (sum of plots in cells 1 and 4 — sum of plots in cells 2 and 3) 
A 


Corresponding to any 2 effects or interactions, say, X and Y, where 
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X and Y contain different selections of the letters A, B, C, D, etc., we 
may divide the treatment combinations as follows: 


For X 


The contrast, treatment in cells 1 and 4 versus treatments in cells 2 
and 3, is known as the generalized interaction of the effects or inter- 
actions X and Y. It is easily verified that this is, in fact, the effect or 
interaction obtained by multiplying the symbols X and Y together and 
equating the square of any letter to unity. Thus we have, for example, 
the results given in Table 13.9. 


Taste 13.9 
X X. Generalized Interaction 
A BC ABC 
AB BC AB'C = AC 


ABCD ABEF A*B'CDEF = CDEF 


13.5.1 The Analysis of 2" Factorial Experiments 

If a 2" experiment. is replieated r times in randomized blocks of 2" 
plots, the analysis follows directly from the definitions. A computa- 
tional procedure is illustrated by an example in Chapter 14. Each 
effect or interaction is estimated by the mean of r2"~' yields minus the 
mean of 72 yields and therefore has a variance of 


which equals 


92 (11) 


Furthermore the estimates of effects and interactions are uncorrelated, 
so that we can obtain the variance of any linear function of them by 
the standard rules. 
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13.6 THE INFORMATION GIVEN BY FACTORIAL 
EXPERIMENTS 


We may sum up the value of the factorial experiment by stating that 
we obtain 
72 


c? 


units of information on every effect and interaction. This may be com- 
pared to the experiment in which we vary one factor at a time. In this 
case, if the error variance c? were the same, we would need exactly the 
same number of experimental units to obtain this amount of information 
on each main effect. In addition to giving equal information on main 
effects, the factorial experiment gives information on the interactions of 
the factors. It must be only rarely in experimentation that interactions 
do not exist. A case in which they may be safely assumed not to exist 
is in the weighing of objects, where the weight of 2 objects is equal to 
the sum of their weights individually. For such a case there is a class 
of designs which have come to be known as weighing designs, and these 
will be discussed in a later chapter. 

If we wish to determine the difference between the yields of 2 treat- 
ment combinations from a factorial experiment, we are in no better 
position than with an experiment designed for estimating this difference. 
In a 2" factorial experiment the difference between 2 treatment com- 
binations is estimated with a variance of 2c7/r, and this is the same as 
if 2r experimental units had been used to estimate this difference, if it 
is assumed that c? is the same in the two cases. The factorial experi- 
ment then does not give exactly the same type of information as the 
experiment with one factor varied at a time unless there are no inter- 
actions of the factors. If, however, there are interactions hetween the 
factors, the factorial experiment. will bring them to the attention of the 
experimenter, whereas’ with the other type of experiment the experi- 
menter can obtain no knowledge of them. In most fields of research, 
particularly any branch of biology, interactions have been found to 
exist. ‘The success of experiments varying one factor at a time can only 
be attributed to the fact that, in general, interactions are of lower mag- 
nitude than main effects. These experiments have, however, certainly 
led to much confusion in biology and probably in other fields also. . 

Fisher? has summed up the advantages of factorial experiments in 
that they result in (1) greater efficiency, as we have seen above, and (2) 
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greater.comprehensiveness in that (a) effects and interactions are esti- 
mated, and (b) conclusions drawn from factorial experiments have a 
wider inductive basis. The exact standardization of experimental con- 
ditions results in information only for the chosen conditions, and the 
experimenter is frequently unable to specify the set of conditions that 
will suit his aims. This is particularly so if the aim of the experimenter 
is to establish best treatments for a wide range of conditions, as occurs, 
for example, in agricultural research or in medical research where the 
aim is to find the treatment that cures a particular illness. The stand- 
ardization that is discussed here should not be confused with the stand- 
ardization of technique and conditions that is designed to reduce the 
error variance. Factorial experimentation does not remove the neces- 
sity for controlling heterogeneity of conditions, but it will result in sets 
of conditions, chosen with respect to some attributes, being represented 
with particular frequencies. 

There are situations in which factorial experiments will be difficult to 
interpret: namely, when high-order interactions are of a magnitude ap- 
preciable relative to the main effects. This fact is, however, not at all 
an argument for experiments in which one factor is varied at a time, 
unless the experimenter does not have the facilities to perform a large 
factorial experiment. For, with one factor varied at a time and the pres- 
ence of interactions, the results will possibly lead to incorrect action, 
and it will often happen that 2 experimenters, using the one-factor ex- 
periment approach, will fail to agree on their conclusions. 

A difficulty that will be encountered with factorial experiments is that 
treatments may not act additively on any one scale of measurement. 
We may expect such to be the case when some of the factors in the 
experiment have effects that are large, say, 40 percent of the mean or 
more. It may be possible, under these circumstances, to find a scale 
for which the treatments are additive in their effects, though we en- 
counter the difficulty that tests of additivity may have rather low power 
in detecting non-additivity. Alternatively, the experiment may be 
divided into parts, for example, by the levels of one factor, for which 
additivity is better satisfied, and, in general, there will be no objections 
to this procedure, for, if effects and interactions are large, the estima- 
tion of their relative magnitude depends very much on the scale of 
measurement used. One such a situation has been shown to exist, the 
procedure of the experimenter is clear, namely, to establish response 


laws for the factors, and for this purpose several levels of the factors 
will be required. 
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13.7 THE SENSITIVITY OF FACTORIAL EXPERIMENTS 


We may use the results of Chapter 12 to obtain an indication of the 
sensitivity of factorial experiments. For the case in which one effect 
(or interaction) of the 2" system with r replicates is tested against a true 
error mean square (i.e., not an error mean square made up of high-order 
interactions), we have 


E (sum of squares for effect) = o? + 72 


where A is the true effect (or interaction) on a per plot basis. So we 


have 
—242 2 
MNA = 72" —3 A 
25? * 02 


and 


Under the circumstances we are considering, we may regard the error 
as being based on, say, 30 degrees of freedom, and, therefore, using 
'Tang's tables we find that, if a 5 percent test of significance is used and 
A/s equals unity, the quantity V 12"? must be, at a minimum, 2.37, 
in order that the experimenter may have a 95 percent chance of con- 
cluding that the effect exists. Therefore, with varying n, we should have 
at least the following numbers of replicate: 


No. of Replicates 
Necessary, r 


3 


* 2 


Corresponding results may be obtained for different values of /. 


REFERENCES 
1. Annual Report. Rothamsted Experimental Station, Harpenden, England. 
1931. , 
2. "ei. R. A. The design of experiments. Oliver and Boyd, Edinburgh. 4th 


ed., 1947. ) ) s 
3. Yates, F. The design and analysis of factorial experiments. Imp. Bur. Soil 
Sci., Harpenden, England, 1937. 


CHAPTER I4 


Confounding in 2" Factorial Experiments 


141 INTRODUCTION 


In the earlier chapter on “Plot Technique," we found that the ex- 
perimental error variance was related to the size of block, increasing to 
a greater or lesser degree as the size of block increased. If we were 
testing 5 factors each with 2 levels, we would have 32 treatment com- 
binations and would require randomized blocks of 32 plots in order to 
compare them. In field experiments it is generally acknowledged that, 
if at all possible, the size of block should not be greater than 16 and if 
possible 8, though, of course, there are no hard and fast rules, and one 
experiment with blocks of 16 may well give a lower experimental error 
than another on similar material with blocks of 8 plots. In other situ- 
ations, it may be impossible to have blocks as large as this without ran- 
domizing over factors that cause considerable variation. It is desirable 
to have some means of reducing the size of block, and for this purpose 
the device of confounding has been found very useful. 

To take the very simple situation of 3 factors each at 2 levels, say, 
a, b and c, we have the effects and interactions defined as in Table 14.1 
(apart from the standard numerical divisor). 


Taste 14.1 


252 
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Suppose that the 8 treatment combinations are arranged in 2 blocks, 
according to their sign in the ABC interaction (Figure 14). 


Block 2 


Ficure 14. 


The quantity we use to estimate A is orthogonal to blocks in that it is 
given by 4(-1+2+3-—4+5-— 6 — 7 + 8) (the numerals denot- 
ing the yields of plots of that number), and of the 4 plots entering the esti- 
mate positively 2 are in each block, and likewise for the 4 plots entering 
negatively. The estimate will then contain none of the additive block 
effects. 

The same is true of the other main effects and 2-factor interactions. 
The 3-factor interaction is, of course, 4(—1 — 2—-3-4+5+64+7 
+ 8), and this estimate measures not only the true ABC interaction 
but also the block difference (block 2 minus block 1). It is not possible 
to separate the true interaction from the block difference, or, in other ` 
words, the interaction and block difference are inextricably mixed up 
or completely confounded with each other. 

The main value of the use of the factorial structure lies in the ob- 
served fact that in many situations the high-order interactions are of 
inappreciable magnitude. If they were not, we would be merely re- 
placing the 32 yields of treatment combinations in a 2° experiment by 
the mean yield and 31 effects and interaetions. It may be noted that 
the words used are “of inappreciable magnitude." It would be a highly 
unlikely event that they were actually zero, because the characteristic 
y may be expected to be a function, say, f(a, b, c, ete.) of the 
levels of factors a, b, c, etc., and, if all interactions involving more 
than 2 factors were actually zero, the function would have to be 


of the form 
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f(a, b, c, ete.) = u + aa + Bib + mie +++: 
+ (a quadratic form in a, b, c, etc.) 


and such a situation is very unlikely. It is likely, however, that over 
a particular range of the levels of the factors, the function f(a, b, c, +-+) 
may be expanded in a Taylor-Maclaurin series of the above form with 
a remainder that is inappreciable compared to the actual value of the 
funetion. In passing it should be noted that, even when interactions 
are not negligible, the factorial strueture and expression of effects and 
interactions is a very useful and logical way of describing the experi- 
mental results.“ 

Suppose then that the 3-factor interaction may be assumed to be 
trivial and we perform the experiment in the 2 blocks given above: i.e., 
with ABC confounded with blocks. As before, we use the reciprocal 
of the true variance of each estimate as a measure of the information 
on each effect or interaction. The results may be condensed as in 
Table 14.2. 

, TABLE 14.2 


Effect or | Information with | Information with 
F Interaction Blocks òf 8 Plots | ABC Confounded 


A 

B 

AB 2r 
0 Ce 3 
AC eh P 
BC 

ABC Zero 


We have supposed there to be r replicates of the whole experiment in 
each case and that the true error variance with blocks of 8 plots and of 
4 plots is «^s and c?,, respectively. We know that c?, will generally be 
less than og, so that we have increased our information on main effects 
and 2-factor interactions in the ratio 


by using blocks of 4 plots, at the expense of obtaining zero information 
on the 3-factor interaction instead of 2r/s*, units, 
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14.2 AN EXAMPLE 


The following experiment conducted to compare the effect of poultry 
manure m with that of equivalent sulphate of ammonia n and super- 
phosphate p on the yield of Brussels sprouts is included to give an illus- 
tration of the use of complete confounding. In the statistical analysis 
of factorial experiments a simple arithmetical procedure is available to 
obtain the estimates of the effects and interactions, and this procedure 


is also illustrated. 


Taste 14.3. DESIGN AND Data OF EXPERIMENT ON BRUSSELS Sprouts ! 


Plan and Yields in Pounds of Salable Sprouts (Total All Pickings) 


I II III 
np j nm nm ; (1) n : p 
48.81 58.88 || 50.43 | 40.26 | 47.37 ; 37.25 
Block Totals 
1 „ um I 192.42 
: i II 192.62 
52.31 49.62 46.87 : 46.94 1 don as 
— — (e RES IV , 189.86 
"i : : V 186.65 
m | npm | p n Em | T VI 179.89 
40.49 61.55 | 32.36 | 48.49 | 39.30 49.93 
B i : Total 1119.87 


p n 
32.75 55.07 


IV 
System of replication: 


Area of each plot: 
"Treatments: 


Basal manuring: 


m i n (D | np 
51.94 | 53.80 || 39.23 | 51.43 


V VI 

3 replicates of 2 randomized blocks of 4 plots each, 6 blocks 

in all. NPM confounded with block differences. 

0.01033 acres (5 yd X 10 yd). 

All combinations of: 

(a) No poultry manure, and poultry manure at the rate of 
0.6 cwt N per acre with addition of superphosphate at 
the rate of 0.116 cwt P2Os per acre, to give a total of 
0.6 cwt P2Os per acre (m). . r 

(b) No sulphate of ammonia, and sulphate of ammonia at 
the rate of 0.6 cwt N per acre (n). 

(c) No superphosphate, and superphosphate at the rate of 


0.6 cwt PO; per acre (p). 
Muriate of potash at the rate of 1.0 cwt K,0 per acre. 
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TABLE 14.4 COMPUTATION or EXAMPLE 


3 
Yield Effects * 
Treatment (0) 1 2 (Totals) Name of Contrast 
(1) 118.11 274.41 526.63 1119.87 Mean 
n 156.30 252.22 593.24 124.75 N 
p 102.36 298.61 85.69 —26.17 P 
np 7 349.86 204.63 39.06 8.68 NP 
m 139.37 38.19 22.19 66.61 M 
um 1389.24 47.50 3.98 —46.68 NM 
pm , 137.72 19.87 9.31 18.21 PM 
npm 156.91 19.19 ,—0.68 —9.99 NPM (confounded) 


Totals for Checks 


Odds 220.47 = a) 573.02-a, 612.32 =a, 1093.70 = a 
Upper halt Pen, 306.16 = by 546.85 2 b, 632.30 2 b, 133.38 = bz 
Odds 277.00 =co  58.00-c —12.88 =c} 84.82 = cs 
* halt Pen, 319,18 0 66.60 c 4.66 — dy 56.62 = d 


* To convert the effect totals to conform to our definition of effects and inter- 
actions divide by (2"7! X no. of reps = 4 X 3). 


To compute the estimates of the effects and interactions the total 
yields for each combination must first be arranged in a standard order 
such as that shown in the column "yield" of Table 14.4, this giving 
column 0. Column 1 is then formed in the following way. The first 
4 numbers are the sums of the pairs of yields labeled w, x, y, and z, 
respectively. The last 4 numbers are obtained by subtracting the upper 
number in each pair from the lower. Thus, 274.41 is the sum of 118.11 
and 156.30 and 38.19 = 156.30 — 118.11. Column 2 is then formed 
in the same manner from column 1, and the process is completed by 
forming column 3 from column 2 similarly. In a 2" experiment, the 
process would be continued through n such stages. The totals for 
checks given at the bottom of Table 14.4 are used in the following way: 


In any column after the first, i.e., columns 1, 2, and 3, the totals must 
satisfy the conditions, 


ai + by = aia + bia + cad dia 


i= 1,23 
C+ dy = —ay + bia — Gi + dia 


Thus, in column 2, for instance, 
az + bz = a4 +b, ＋ ei +d 
1244.62 = 573.02 + 546.85 + 58.06 + 66.69, the sum of the four 


totals in the preceding column 1 
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Cs + dy = 0s + be — ca + dh 
or 


28.20 = [— (612.32) + (632.30) — (—12.88) + (—4.66)] 


This gives a check of all entries in the table other than the yields. 
The analysis of variance is given in Table 14.5. 


TABLE 14.5 ANALYSIS OF VARIANCE OF EXPERIMENT 
Sum of Mean 


Source of Variation df Squares Square 
Blocks 

Reps 2 42.59 

NPM 1 5 4.16 

Reps X NPM 2) 1.38 
Treatments 

N 1 

P 1 i 

NP 1 

M 1 6 969.37 

NM 1 

PM 1 
Error 12 340.81 28.40 

Total 23 1,358.31 


The detailed computations are as follows: 


1119.87)? 
Correction factor: ws = 52,254.53 


Total sum of squares: (48.81)? ------- (51.43)? — CF = 1358.31 
Block sum of squares: }{(192.42)? +- -+ (179.89) ] — CF = 48.12 
Replicate sum of squares: 

4{(382.28)? + (379.27)? + (358.32) — CF = 42.59 


—9.99)? 
Sum of squares for NPM: — = 4.16 


Sum of squares for replicates: block ss — (rep ss + ss for NPM) = 1.38 
Treatment sum of squares: giz(124.75)? +-+- + (18.21)? — 969.37 
Error sum of squares (by subtraction): 340.81 


^ 


` 
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As explained previously, it is immaterial whether an P test, with 1 
and 12 degrees of freedom, or a ¢ test with 12 degrees of freedom is used 
for testing the main effects and unconfounded interactions. The re- 
sults may be presented thus: 


Total Effects 
N 124.75 
ji —26.17 SE = V 24(28.40) = 26.1 
NP 8.63 
M 66.61 5% sig. level = 55.98 = (26.1)to.o5, 12 df 
NM —46.63 


PM 18.21 1% sig. level = 77.70 = (26.1)to,o1, 12 df 


It may be worth while to note that the sum of squares for reps X 
NPM may be obtained in the following way: 


` NPM (-) 192.42 192.62 179.89 
NPM (+) 189.86 186.65 178.43 


SS for NPM x : 2 2 z — (29.9) 
, reps = 5 [(—2.56)° + (—5.97)? + (—1.46)"] - —— 7-7 1.38. 


We may also note that formally we have a test of NPM by comparing 
the mean square for NPM with the mean square for NPM X reps. 
This test has, however, very low sensitivity and in the present case is 
very unreliable, 

In presenting the results of the yields of treatment combinations and 
the estimates of the effects and interaction, results should be converted 
to the customary units: in agriculture, for instance, bushels, tons or 
hundredweights per acre. In the present case the yields per plot can 
be converted to ewt (= 100 Ib) per acre by multiplying by the factor 
1/0.01033 X oo = 0.968. To obtain the mean yields for treatment 
combinations and what we have defined as the main effects and inter- 
actions in terms of hundredweights per acre, the entries in the column 
“yields” and column 3 of Table 14.4 are multiplied by 0.968/3 and 
0.968/12, respectively. "The standard error for the main effects and 
interactions (excluding NPM), when converted, is then 


l E [28.40 
0.968 =- U. — = 
m 0.968 7 2.11 
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Finally, a convenient way to summarize the results of the experiment 
in a concise form is given in Table 14.6. 


TABLE 14.6 Presentation or RESULTS 


Mean Yield = 45.1 ewt per Acre 


Avg. Effects 
Absence 


Absence 


V I!̃˖ůͤ EM iex N-NP 
10.06 


SE 2.1 211V2 = 2.98 


It may be desirable from some points of view to present also a table 
of the yield of each treatment combination. In the case of the experi- 
ment under discussion, we have no information on the 3-factor interac- 
tion, so that it is impossible to estimate the block effects and, hence, 
remove them from a table of yields. The yield of each treatment com- 
bination, if it is assumed that the 3-factor interaction is negligible, is 
easily computed. 

The plus and minus process of Yates, given here for obtaining effects 
and interactions from the yields of the treatment combinations, can be 
used inversely to obtain the yields of the treatment combinations from 
ihe mean, effects, and interactions. The modification is to arrange the 
interactions, effects, and twice the mean in backward order in a column 
and to go through the same addition and subtraction process. This 
leads to twice the yields of the treatment combinations in standard 


order. 


14.3 SYSTEMS OF CONFOUNDING FOR 2" EXPERIMENTS 


Suppose we have 5 factors, a, b, c, d, e, giving 32 treatment combina- 
tions in all and we wish to use blocks of 8 experimental units. The ex- 
periment will consist of 4 blocks of 8 units, and there will be 3 effects 


or interactions confounded with blocks. 
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If we confound the interaction ABC, the treatment combinations fall 
into 2 groups, each group consisting of 2 of the blocks, namely: 


(a) : (1), ab, ac, be, d, abd, acd, bed, e, abe, ace, bee, de, abde, acde, bede 
(8) : a, b, c, abc, ad, bd, cd, abcd, ae, be, ce, abce, ade, bde, cde, abcde 

Ik we also confound, say, ADE, we divide the treatment combinations 
again into 2 groups: 

(Y: (1), ad, ae, de, b, abd, abe, bde, c, acd, ace, cde, be, abcd, abce, bede 
(8): a, d, e, ade, ab, bd, be, abde, ac, cd, ce, acde, abe, bed, bee, abede 


If each of the comparisons (a) versus (8), and (y) versus (ô) are to be 
block comparisons, the blocks must consist of the following: 


(1) treatments in (a) and (y) 
(2) treatments in (a) and (6) 
(3) treatments in (8) and (y) 
(4) treatments in (8) and (5) 


'The blocks are then as shown in Table 14.7. 


TABLE 14.7 Brocks 


a) (2) (3) (4) 


(1) d b a 

bc bed c abc 
de e bde ade 
bede bee cde abcde 
abd ab ad bd 
acd ac abed ed 
abe abde ae be 
ace acde abce ce 


The interaction ABC is equal to blocks 1 and 2 versus blocks 3 and 4, 
and the interaction .ADE is equal to blocks 1 and 3 versus blocks 2 and 
4. These are 2 orthogonal contrasts among the 4 blocks, and there is 
a third contrast orthogonal to each of these: namely, blocks 1 and 4 
versus blocks 2and 3. It is easily verified that this is, in fact, the inter- 
action BCDE. 

The general rule exemplified by this case is that, if any 2 effects or 
interactions are completely confounded with blocks, then so is their 
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generalized interaction, as defined in the previous chapter. This en- 
ables an easy enumeration of systems of confounding. We give in 
Table 14.8 typical examples of the systems of confounding for up to 8 


Taste 14.8 Types or CONFOUNDING FOR 2" FACTORIAL SYSTEMS 


The same confounding is possible for a 2” experiment in blocks of 2* as for a 27 
experiment in blocks of 2**». These are therefore not included. 


(1) 2 factors, 
Blocks of 2 Any one effect or interaction 


(2) 3 factors 
Blocks of 4 Any one effect or interaction 
Blocks of 2 AB, AC, BC 
A, BC, ABC 
(3) 4 factors 
Blocks of 8 Any one effect or interaction 
Blocks of 4 4, BCD, ABCD 
AB, CD, ABCD 
AB, ACD, BCD 
Blocks of 2 4, B, AB, C, AC, BC, ABC 


A, BC 
AB, A 
(4) 5 factors 
Blocks of 16 Any one effect or interaction 
Blocks of 8 4, BCDE, ABCDE 6 
AB, CDE, ABCDE i 
ABC, CDE, ABDE 
Blocks of 4 A, B, AB, CDE, ACDE, BCDE, ABCDE 
A. BC, ABC, DE, ADE, BCDE, ABCDE 
A, BC, ABC, CDE, ACDE, BDE, ABDE 
AB, AC, BC, DE, ABDE, ACDE, BCDE 
AB, CD, ABCD, BDE, ADE, BCE, ACE 
Blocksof2 AB, AC, AD, AE, and all generalized interactions 
A, BC, BD, BE and all generalized interactions 


For the case of 6 factors or more, we shall list only systems of confounding which 
ure more frequently useful ones, and some others of interest. 


(5) 6 factors 
Blocks of 16 ABCD, CDEF, ABEF 
Blocks of 8 ACE, BDE, ABCD, BCF, ABEF, CDEF, ADF 
Blocks of 4. AB, CD, ABCD, EP, ABEF, CDEF, ABCDEF 
ACE, BUE, ADE, BDE, ACF, BCF, ADF, BDF 
Blocks of 2 AB, AC, AD, AE, AF, and all generalized interactions [not 
particularly useful except with partial confounding (Chap- 
ter 15)] 
A, BC, BD, BE, BP, and all generalized interactions 
(6) 7 factors 
Blocks of 16 ACEG, BDE, ABCDG, BCF, ABEFG, CDEF, ADFG 
Blocks of 8 ABC, ADE, BCDE, BDF, ACDF. ABEP, CEF, ABCDEFG 
DEFG. BCPG, AFG, ACBG, BEG, CDG, ABDG 
Blocks of 4 AB, AC, AD, AE, AF, AG, and all generalized interactions 
(again not particularly useful) 8 4 
A, BC, BD, BE, BF, BG, and all generalized interactions 


„ 


(7) 8 factors y 
Blocks of 16 As for 7 factors in blocks of 8 ) TER 
Blocks of 8 ABC, ADE, AFG, BDG, and CH and all their generalized inter- 
actions; CH ia the only 2-factor interaction confounded 


262 CONFOUNDING IN 2” FACTORIAL EXPERIMENTS 


factors. Only those systems are given that result in a block size of 16 
orless. The allocation of letters to factors is a matter for the experi- 
menter, and the type exemplified by ABC, ABD, CD for 4 factors in 
blocks of 4 plots includes 5 additional systems: namely, AB, ACD, 
BCD; AC, ABD, BCD; AD, ABC, BCD; BC, ABD, ACD; BD, ABC, 
ACD. If the experimenter wishes to use this type of confounding, he 
should decide which of the six 2-factor interactions is least important 
and choose the system involving that one. 

There is a remarkable theorem obtained by Fisher? that, so long as 
the number of units in the block exceeds the number of factors, we can 
find arrangements in which no confounded interaction involves less than 
3 factors. 


144 THE COMPOSITION OF BLOCKS FOR A PARTICULAR 
SYSTEM OF CONFOUNDING 


. The composition of the blocks may be simply obtained by first con- 
structing the so-called intrablock subgroup. This group is based on 
the following properties. Firsj, when an effect or interaction is con- 
founded, all the treatment, combinations in a block have either an even 
number of letters in common with the effect or interaction or an odd 
‘number. No 2 treatment combinations iri the same block can have one 
an odd number of letters and the other an even number of letters in 
common with any effect or interaction that is confounded. Second, the 
treatment combinations in any one block may be obtained from those 
in another block by multiplying the symbols of the treatment combi- 
nations in the one block by the symbol of any treatment combination 
in another block, replacing the square of any letter by unity. Third, 
the treatment combinations in the block containing the control form a 
group if the symbol (1) is treated as unity, and the rule of multiplica- 
tion is the ordinary algebraic rule with the square of any letter replaced 
by unity. These treatment combinations form an Abelian group. The 
treatment combinations in the block containing the control is called 
the intrablock subgroup. 


144.1 Example 1. 2° Experiment Confounding AB, AC, and BC 

Each block will contain 2 treatment combinations, and we first ob- 
tain the intrablock subgroup. This contains treatment combinations 
with an even number of letters in common with the symbols AB, AC, 
and BC. Clearly there are only 2: namely, the control (1) which has 
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no letters in common, and abe with 2 letters in common with each of 
AB, AC, and BC. The intrablock subgroup is then (1) and abe. 


Intrablock subgroup (1), abe Block I 

Multiply by a a, abe = bc Block II 
Multiply by b b, ab’c = ac Block III 
Multiply by c c, abe? = ab Block IV 


Note that the second rule holds in that, for example, block II is obtained 
from block I by multiplying the elements of block I by a, but could have 
been obtained by multiplying these elements by be. The third rule is 
exemplified by the following relations: Y 

(1) x (1) = (1) 

(1) X abc — abc 

abc X abc = a*b?c? = (I) 


14.4.2 Example 2. 27 Experiment in Blocks of 16 Plots 
Suppose we confound ABC, DEF, ABCDEF, BDG, ACDG, BEFG, 

ACEFG. To obtain the intrablock subgroup, we ascertain which treat- 
ment combinations have an even number of letters in common with 
each of the 7 interactions. To do this we run through the treatment 
combinations systematically in the order: a, b, c, d, e, f, g, ab, ac, ad, 
ae, af, ag, be, bd, be, bf, bg, ed, ce, ef, eg, de, df, dg, ef, et fos abc, abd, abe, 
abf, abg, acd, ace, acf, and so on. The first treatment combinations 
with the desired property ure ac, €/, and with these we get the 4 treat- 
ment combinations: (1) 

ac 

ef 

acef (= ac X ef) 

Next, we find abg, and this, combined with the 4 above, gives 


(1): 
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Finally we find deg, and this, with the above elements and their products 
with deg, gives column I of Table 14.9. 


Tanin 14.9 Brock STRUCTURE FOR 27 EXPERIMENT 


I II III IV V VI VII VIII 
a) a b d e g ad ae 
ac c abc acd ace acg cd ce 
ef aef bef def y efg adef af 
acef cef abcef acdef acf acefg cdef cf 
abg bg ag abdg abeg bdg beg 
beg abg: | cg bedg bceg be abedg abceg 
abefg | befg aefg abdefg | abfg abef bdefg bfg 
bcefg | abcefg | cefg bedefg | befg beef abedefg | abcfy 
deg adeg bdeg eg dg de aeg adg 
acdeg | cdeg abcdeg aceg acdg acde ceg cdg 
dfg adfg bdfg fg defg df afg adefg 
acdfg | cdfg abcdfg | aefg acdefg | acdf cfg cdefg 
abde | bde ade abe abd abdeg be bd 
bede abcde cde bee bed bedeg abce abed 
abdf | bdf adf abf abdef abdfg | bf bdef 
bedf abedf | cdf bef bedef bedfg | abef abcdef 


The elements in the other columns are obtained by multiplying the 
first column by a (giving II), b (giving III), by d, e, g, ad, ae, in order. 
Note that block II would be generated again by multiplying block I 
by the element c. As a final check one should: 


- (a) Check that all treatment combinations are present. 

(b) Check that one block other than I has the property of having 
either an odd or an even number of letters in common with each of the 
confounded interactions. À 

(c) Obtain each block other than that in b by multiplication by a 
symbol in this other block. 


The statistician is frequently presented with the job of analyzing an 
experiment that he has not designed. It is then necessary for him to 
discover the system of confounding on which the plan is based. This 
may be done by reversing the above procedure. Take, for example, 
the block given above consisting of ad, cd, adef, edef, bdg, abedg, bdefg, 
abcdefg, aeg, ceg, afg, cfg, be, abce, bf, and abef. No 2-factor interactions 
are confounded because no 2-factor interaction has a number of letters 
in common with each of the treatment symbols which is always even or 
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always odd; e.g., AB has 1 letter in common with ad and none in com- 
mon with cd. We note that ABC has either 3 or 1 letters in common 
with each of the treatment symbols; also BDG. The product of these, 
ACDG, has either 4, 2, or no letters in common with the treatment sym- 
bols. Also DEF has 3 or 1 letters in common. The confounded inter- 
actions are then 


ABC, BDG, ACDG (= ABC X BDG), DEF 
ABCDEF (= ABC x DEF), BEFG (= BDG X DEF), and 
ACEFG (= ACDG X DEF) 


14.6 THE EFFECTS OF DIFFERENTIAL TREATMENT 
EFFECTS IN BLOCKS 


There is one aspect of confounding that merits attention, namely, 
that, depending on the nature of the blocks and how they were con- 
structed, and on the nature of the treatments, the true treatment effects 
may vary from block to block. A brief discussion of 
this problem is given in references 4 and 5. 

The general effect of such interactions may be il- I 
lustrated simply in the 2? experiment on factors a, b, —— 
c with ABC confounded. The plan will be (apart from a T 


II 


randomization) as shown ın Figure 15. er 
Suppose a produces an effect in block I and no effect ab b 
. in block II and the effects of factors b and c are ad- ^s : 


ditive with no interactions. Then, in addition to show- 
ing effects of a, b, and c, the experiment analyzed in the | a 
usual way will show an interaction of b and c. This 
is almost obvious but may be verified by constructing 
the yields of the treatment combinations in accord- Fioure 15. 
ance with previously given rules, allowing for an effect Eis 
B, an effect C, no interactions, ied effect of, say, A in the firs 
block and of zero in the second block. . 

Similarly, in an experiment in which, say, ABCD is confounded, 7 
significant BCD interaction could have arisen from the existence o! 


differential responses to a in i 

The importance of these effects s r 
on the other hand, should not be ignored. The Loo dome din 
be aware of the possibility of such effects confusing his interpretation o 
an experiment and guard against it. A similar argument applies, as 
we found, to the ordinary randomized blocks experiment in that differ- 
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ential effects of treatments from block to block can produce heteroge- 
neity of error, with inaccurate estimation of the error of treatment com- 
“parisons. 


146 THE USE OF ONLY ONE REPLICATE 


The effects and interactions with the 2" factorial scheme may be 
enumerated thus: 


Main effects n 

2-factor interactions — 

3-factor interactions mone 
` Total 2^ —] 


We have already considered the case when some of the interactions in- 
volving several factors can be regarded as trivial. It is a simple exten- 
sion of this principle, to suppose that interactions involving several fac- 
tors may be used to estimate the experimental error. Take a 2° ex- 
periment, for example. The 63 effects and interactions consist of: 


Main effects 6 
2-factor interactions 15 
3-factor interactions 20 
4-factor interactions 15 
5-factor interactions 6 
6-factor interactions 1 


If we may regard interactions involving 4 or more factors as trivial, 
we may estimate the error variance by the mean square due to these 
interactions, this being based on 22 degrees of freedom. 

The effect of including, in the sum of squares by which the error is 
estimated, some non-zero high-order interactions will be to inflate this 
estimate of error variance. The actual effect may be expressed in 
terms of the true interactions. This inflation will be negligible for most 
types of factorial experiments, though, in some instances, it can be ap- 
preciable. For example, if main effects or 2-factor interactions are very 
large compared with the mean, it may be expected that a function in- 
volving, say, only terms of up to the second degree in the amounts of 
the factors may give an inadequate representation of the yields. 
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If the true value of an interaction term in a 2” experiment is I, the 
expectation of the sum of squares for the corresponding degree of free- 
dom is o? + 2212. The bias in the estimation of c? will then be 
2”—2 (average value of I), the average being taken over the interaction 
terms included in the error sum of squares. The process more or less 
followed is to use higher-order interactions for the larger experiments, 
so that, as n increases, the average value of I? will generally decrease, 
and it is not easy to visualize the over-all effect of this procedure. The 
error sum of squares will not be distributed approximately according to 
xls? with the appropriate degrees of freedom (if the infinite model 
holds), but according to the non-central x” distribution (Chapter 12). 
The general result will be an underestimation of the significance of 
effects, with an overestimation of the errors of estimated effects. It 
appears that this bias could, under some circumstances, be quite ap- 
preciable, particularly if the error variance is small relative to effects 
and interactions. Under some circumstances, particularly in determin- 
ing broad technological procedures, this bias is probably not important, 
but, in more accurate scientific research, a single replicate cannot be 
regarded in any way as adequate with less than, say, 6 factors. 


14.7 AN EXAMPLE 


The illustration of these principles is a report of an experiment con- 
ducted at Rothamsted to determine the effect of certain fertilizers on 
the yield of mangolds (Table 14.10). 

Since the confounded interactions are not indicated, we proceed to 
determine them. We note first that the intrablock subgroup is (1), kd, 


6 
Tapte 14.10 PLAN AND YIELDS IN pouxbs or MaNcoLp Roots 


I Il 
. 2020 -o——— 


pkd nd sk spknd d pkid k snd 
844 1104 1156 1508 1248 1100 784 1376 


Block Totals 
8,988 

spn kn sd p spkd skn sp pr I i 
888 1356 1376 1008 964 11 9,212 
1312 1000 1176 m vu 
kd spd pnd pkn skd spkn knd 2. IV 8,540 
1328 1292 1008 1 * — 
* -— Total 35,152 


en s (1) sknd pi pk n s 
1184 " 740 1468 1008 692 780 1108 


III IV 
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Taste 1410 Puan AND Yroups mw Pounps or MawGoLp Roors® (Continued) 


System of replication: 4 randomized blocks of 8 plots each. Certain high order 
j interactions are confounded with blocks. 


Area of each plot: (After rejecting edge rows) 0.02322 acre. Plots actually 


Ms acre. 
Treatments: 25 factorial design 
É Sulphate of ammonia: None, or 0.6 cwt N per acre (s) 
Superphosphate: None, or 0.5 cwt P»O; per acre (p) 
Muriate of potash: ^ None, or 1.0 cwt K20 per acre (k) 
Agricultural salt: None, or 5 ewt per acre (n) 
Dung: None, or 10 tons per acre (d) 


Basal manuring: Nil 

spd, pnd, pkn, sn, spk, sknd. Since all the 3-factor treatment combina- 
tions in this subgroup contain p, which is not included in sknd, and, 
since the remaining elements of the subgroup are check and 2-factor 
interactions not including p, we know that SKND is confounded. Af- 
ter further inspection we note that PKD is confounded, and hence the 
remaining confounded interaction is SPN. (SPN x PKD = SP?KND 
= SKND.) 


No. of Letters in Common 


Interactions 
(1) | kd |: spd | pnd | pkn | sn | spk | sknd 
SKND 0 2 2 2 2 2 2 4 
PKD 0 2 2 2 2 0 2 2 
SPN 0 0 2 2 2 2 2 2 


First compute Table 14.11. 


If we assume that the error is estimated from the unconfounded 3-, 
4-, and 5-factor interactions, the analysis of variance table is constructed 
in the following way. 


1 
Correction factor: — = 38,614,470 


Total sum of squares: (844% + (1104)? +-..+4 (1108)? — CF = 40,176,128 — CF 
= 1,561,658 


Error sum of squares: yy (sum of squares of unconfounded 3-, 4-, and 5-factor inter- 
action totals) = 88,286 
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Treatment sum of squares: „y (sum of squares of total main effect and 2-factor 
interactions) = 1,420,538 

Block sum of squares: hy (sum of squares of total PKD, SPN, and SKND) = 52,832 

Note that the sums of squares for treatment, blocks, and error, except 

for a multiplicative factor, are obtained immediately by squaring and 
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Treatments Yields 1 2 3 4 5 Tolal Effects 
(1) 740 1848 3744 7360 16128 35152 Mean 

8 1108 1896 3616 8768 19024 5328 S 

p 888 1940 4240 9140 2712 —312 P 

sp 1008 1676 4528 9884 2616 104 SP 

k 784 1964 4716 1152 —128 152 K 

sk 1156 2276 4424 1560 —184 1240 SK 

pk 692 2376 4800 1148 —328 —448 PK 

spk 984 2152 5084 1468 432  —96 SPK 

n 780 2424 488 —216 160 2152 N 

n 1184 2292 664 88 —8 728 SN 

pn 864 2224 752 —156 232 432 PN 

spn 1312 2200 808 —28 1008  —96 SPN (confounded) 
kn 1000 2480 204 —328 —848 992 KN 

skn 1376 2320 944 0 400 —592 SKN 

pkn 860 2476 600 428 280 —40 PKN 

spkn 1292 2608 868 4 —376 104 SPKN 

d 1248 368 48 —128 1408 2896 D 

sd 1176 120 —264 288 744 —96 SD 

pd 1008 372 312 -292 408 —56 PD 

spd 1284 292 —224 284 320 760 SPD 

kd 806 404 —132 176 304 —108 KD 

skd 1328 348 -24 56 128 776 SKD 

pkd 844 376 —160 740 328 1248 PKD (confounded) 
spkd 1356 432 132 268 —424 -656 SPKD 

nd 1104 72 -248 -312 416 —664 ND 

snd 1376 276 -80 -536 576 —88 SND 

pnd 906 432 —56 108 —120 —176 PND 

spnd 1324 512 56 292 —472 —752 SPND 

knd 1008 272 348 168 —224 100 KND 

sknd 14608 328 80 112 184 —352 SKND (confounded) 
pknd 1100 460 56 —268 —56 408 PKND 

spknd 1508 408 —52 -108 160 216 SPKND 


Totals for check: ; 
Upper {Odd 6708 17732 19544 18528 18208 38080 
half|Even 9420 17420 20936 21744 22912 6720 


Lower {Odd 8204 2612 168 192 2464 
half Even 10820 2716 376 6586 1216 —192 
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N summing the relevant entries in column 5, Table 14.11. In addition 
to the usual check for the entries in Table 14.11, a further check of the 
calculations is thus available in this case: The total sum of squares cal- 
culated directly from the yields of the treatment combinations must be 
the total of the sums of squares for blocks, treatments and error as cal- 
culated above. 

TABLE 14.12 ANALYSIS OF VARIANCE 


Source of Variation df Sum of Squares Mean Square 


Blocks 3 52,832 

Treatments 15 1,420,538 

Error 13 88,286 6,791.23 
Total 31 1 2501 656 


Mean yield: 1,098.50 Ib per plot 
Standard ‘error: 82.4 Ib per plot or 7.5 percent of the mean 


Finally the effects and interactions should be converted to tons per 
acre and the results summarized in the usual form (indieated in the 
previous illustrative example). 
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CHAPTER 15 


Partial. Confounding 


in 2" Factorial Experiments 


15.1 A SIMPLE CASE 


Consider the simplest possible factorial scheme, that involving 2 fac- 
tors a, b, each at 2 levels, and suppose that it is necessary to use blocks 
of 2' experimental units. The necessity of blocks of this size might 
arise, for example, in an experiment on young cattle, because it is easy 
to obtain a number of identical twins: that is, twins of the same genetic 
constitution and each pair of twins being a block. "The advisability of 
using such material follows from the fact that error variance may be 
reduced to as little as 10 percent of the value with a randomly chosen 
pair. Again it may be that the experimenter can handle only 2 experi- 
mental units at the same time and that, if units were treated in random 
order, the experimental errors introduced by randomizing over “times” 
would be considerable. Another possible use of blocks of 2 plots would 
be in plant pathological work, the block being a leaf and the plots the 
2 halves. Suppose also that the experimenter wishes to obtain informa- 
tion on both main effects and the 2-factor interaction. 

The basic pattern of the experiment would then consist of 3 replicates 


arranged as in Figure 16. 


nae NS Replicate II Replicate III 
Block 1 6 ab Block 1b ab Block 1 | (1) ab 
2 (0 5 2 00 a ala ^ 
FIGURE 16. 


Such a design arises if we decide that each treatment combination 
shall oceur with every other treatment once in a block and is, therefore, 
. 271 
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one of the general class of designs called *balanced incomplete block 
design.” We do not consider this class of designs until later chapters 
but examine the pattern in Figure 16 from the factorial point of view. 

It is obvious that in replicate I we have confounded with blocks the 
effect A, in replicate II the effect B, and in replicate III the 2-factor 
interaction AB. Each effect and interaction is then “partially con- 
founded” with blocks. In view of this, we shall estimate the effects 
and interaction from the replicates in which they are unconfounded 
with blocks: namely, 


Estimated from 
Replicates 
Effect A Il, III 
Effect B I, IH 


Interaction AB E 


These estimates will be subject to an error based on the variance of units 
within blocks of 2 units treated alike, and, in order to obtain a reasonably 
precise estimate of this error variance, we shall need several repetitions 
of the basic pattern. Supposing we have r repetitions of the basic pat- 
tern (ie., 3r replicates in all), the analysis of variance will have the 
structure shown in Table 15.1. 


TABLE 15.1 STRUCTURE OF ANALYSIS OF VARIANCE 


df 
Replicates 3r — 1 
Blocks within replicates 3r 

A 1 

B i 

AB 1 
Experimental error 6r —3 

Total 12r — 1 


It is somewhat difficult to devise a notation that will allow all the 


mean squares to be written down algebraically, and so they will bc 
described. 


1. Replicate Sum of res 
(grand total)? 


12r 
2. Blocks within Replicates. For each replicate we will have 


(total of replicate)? 
4 


1 
n (sum of squares of replicate sums) — 


1 
7 (sum of squares of block totals) — 
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each of these sums of squares having one degree of freedom, and there 
being 3r in all. 
3. Sum of Squares for A. The estimate of A will be 


1 
A= i (sum of plots with a — sum of plots without a) for replicates of 
types II and III] 
- Lu 
E" idi 


The suni of squares will be [A]?/8r. ^ 
4. Sum of Squares for B. The estimate of B will be 


1 
E [(sum of plots with b — sum of plots without b) for replicates of types I 
1 
and III] = —[B] say, 
4r 


and the sum of squares will be (B]?/8r. 
5. Sum of Squares for AB. The estimate of AB will be 


1 
25 (sum of plots with neither or both of a and b — sum of plots with one 
1 
of a and b) for replicates of types I and II] = Fe [AB] say, 
T 


and the sum of squares for AB will be [AB]?/8r. 

6. Sum of Squares for Experimental Error. This may be obtained by 
subtraction. 

It is of value in the analysis of most experiments, where possible, to 
examine the structure of the sum of squares for experimental error. 
We note that this is obtained in the following way. The effect 1 is es- 
timated from 2r replicates in all, and we could number these replicates 
1, 2, . 2r and the estimate in each replicate 14[A,], where i runs from 
1 to 2r. The differences between these estimates are attributable en- 
tirely to experimental error, each estimate being a comparison within 
blocks of the replicate. It follows that 


Slap- žar 
dui 4 i 8r 
c?, where c? is the experimental error. Simi- 


is an estimate of (2r — 1) 
) degrees of freedom, making 


larly, B and AB each contribute (2r—1 
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up the total of (6r — 3) degrees of freedom for experimental error. The 
tests of significance are made in the usual way. s ; 
With the usual procedure for obtaining the variance of a linear func- 
tion of random normal variables, the true variance of the estimate of 
A is 1 92 
— (4r + 4r)? = — 
(4r)? ' 2r 


and likewise for B and AB. 


15.2 EFFICIENCY OF PARTIAL CONFOUNDING 


In many cases the experimenter testing 2 factors may have the choise 
of using blocks of 2 units with partial confounding or bloeks of 4 units 
with no confounding. If blocks of 4 units were used, each effect and 
interaction would be estimated from all of the replicates and would be 
subject to an error variance of c?^,/3r, where c^, is the error variance 
with blocks of 4 units. 


Information 


Above Partial 
Confounding 


No Confounding 


The information of the partially confounded scheme, relative to that 
of the scheme with no confounding, is 


where the subscript on o? denotes the number of units per block. If 
c?, is greater than 34075 (or a°; is less than 25074), the information is 
greater with the partially confounded design. In general, c?, will be 
greater than c^», but whether it will be sufficiently greater to give the 
advantage to the partially confounded design depends on the experi- 
mental material. We have considered a scheme of partial confounding 
which results in equal information on main effects and the 2-factor in- 
teraction, but it may be more appropriate to obtain greater information 
on main effects. This would entail greater representation of replicates 
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of types I and II than of replicates of type III, to an extent depending 
on the relative amounts of information required. 


15.3 PARTIAL CONFOUNDING OF 2? EXPERIMENTS 


The arrangements utilizing partial confounding that are best for any 
situation depend on the information the experimenter wishes to obtain. 
Suppose, for example, with an experiment on 3 factors, a, b, c, each at 
2 levels, the experimenter desires the maximum possible accuracy on main 
effects and equal information on the 2-factor and 3-faetor interactions. 
He will then use a number of repetitions of the pattern shown in Figure 17. 


I Il III IV 
(1) |a (1) || b (1) || a 
ac c bc c ab || b 
b ab a ab ac || c 
abe || be abe || ac bc || abe 
Canfoundiog AR AC BC ABC 


FIGURE 17. 


Suppose he uses r repetitions, the position of replicates, blocks within 
replicates, and plots within blocks being randomized. The informa- 
tion on each effect and interaction with no confounding and with the 
above system is given in Table 15.2, and the estimates will be made in 


the stated replicates. 


TABLE 15.2 INFORMATION GIVEN By DESIGN ror 2° System IN BLOCKS OF 4 


No Confounding : Above Pattern 
Inſorma- Estimate from 0 Estimate from 
lion ion 


8r/o°4 All replicates 


a Sr/c, | AN replicates 

AB 670024 Replicates of types II, III, IV 
0 = All replicates || 8r/o% | All replicates 

ac IS 6r/s, | Replicates of types I, III, IV 
BC 670 Replicates of types I, II, IV 
ABC 6r/e^, Replicates of types I, II, IH 
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The units of information on each effect and interaction are obtained 
by noting that, for example, the effect A is estimated from all replicates 


1 
and, on a single plot ane will bes — m of 16r plots — sum of 16r 


m 
plots) with a variance of 16275 za (16r + 167) o? i = Interaction AB, 
T 


for example, will be m un from replicates of types II, III, and IV, 
because the replicates of type I give no information on AB, which may 


1 
be separated from block differences. It is, therefore, AN to ms (sum 
of 12r plots — sum of 12r plots) and has a variance of 42275 jue + 127) 


= a Note that the information on interactions relative to main 


effects is 34, which is easily seen since the interactions are based on 34 
of the replicates. The variance of main effects is o7,/8r, and that of 
interactions will be 

02 4 4 o? 4 


—— aS 
Bie o> Or 
If a°, is less than 3407s, the partially confounded design will yield 
more information on interactions than the unconfounded design and 
substantially more information on main effects. 


The partition of degrees of freedom in the analysis of variance will 
be as in Table 15.3. The calculation of the sums of squares is made ex- 


Taste 15.3 STRUCTURE or ANALYSIS OF VARIANCE 


Replicates 
Blocks within replicates 
A 


B 
AB 
c 
AC 
BC 
ABC 
Error 


I 
x 


Total 32r 


actly analogously to the previous case. 


| 
~ 
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It is instructive to examine the constitution of the block sum of 
squares and of the error sum of squares. First, the degrees of freedom 
for error are shown in Table 15.4. 


Tass 15.4 

A by replicates (All) 4r-1 
B by replicates (All) 41 — 1 
C by replicates (All) 4 — 1 
AB. by replicates (II, III, IV) 37 — 1 
AC by replicates — (I, III, IV) Zr — 1 
BC by replicates (I, II, IV) Zr — 1 
ABC by replicates (I, II, HD) Zr — 1 

Total 24r — 7 


The interaction AB, for example, is estimated from 3r replicates, and 
the sum of squares between "the estimates for each replicate will have 
(3r — 1) degrees of freedom. 

The composition of the block sum of squares is obtained from the 
fact that each of the interactions AB, AC, BC, and ABC is confounded 
in r of the replicates, so that the sum of squares could be broken down 


according to the partition given in Table 15.5. 


Tasis 15.5 
df 
AB 1 
AC 1 
BC 1 
ABC 1 
Block error 4r — 4 
Total år 


This is mentioned here as a simple illustration of the fact that infor- 
mation on confounded interactions can be obtained from block compari- 
sons. Itis usual with small experiments to ignore this information, re- 
lying completely on intrablock (i.e., within block) comparisons. When 
we deal with quasifactorial designs, we shall find the utilization of this 


information to be important. 


15.4 CONFOUNDING WITH 4 FACTORS IN BLOCKS OF 4 
PLOTS 


As a more complicated example of partial confounding the following 
is of some interest for 4 factors in blocks of 4 plots. The basic pattern 


is of 4 replicates, the confounding being 
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Replicate Confounding 
I AB, CD, ABCD 
II AC, BD, ABCD 
III AD, ABC, BCD 
IV BC, ABD, ACD 


In this case there is full information on main effects, 34 information on 
2- and 3-factor interactions and 14 information on the 4-factor interac- 
tion. 

A second example on the 2* system in blocks of 4 plots is based on the 
completely orthogonalized 4 X 4 square. Consider the square shown 
in Table 15.6. 


TABLE 15.6 


If we insert a completely orthogonalized square, it will be found that 
making up blocks according to rows, columns, Latin letters, Greek let- 
ters, and numerals (say) corresponds to the confounding of 


A, B, AB 
Gr D OD 
AC, BD, ABCD 
AD, ABC, BCD 
BC, ABD, ACD 
The analysis of such an experiment is left to the reader. 


15.5 PARTIAL CONFOUNDING OF A 2. EXPERIMENT IN 
BLOCKS OF 2 


As a final example of partial confounding of a 2" experiment in a de- 
sign with one restriction, we may consider the case of a 2* experiment 
in blocks of 2 plots. With r replicates we shall have 7r degrees of free- 
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dom for blocks, up to 15 for treatment and, therefore, about (9r — 15) 

degrees of freedom for error. In order to have an error based on a rea- j 
sonable number of degrees of freedom, we need at least 4 replicates. 
With 4 replicates, the best confounding appears to be (cf. Table 14.8): 


I A, BC, ABC, BD, ABD, CD, ACD 
II B, AC, ABC, AD, ABD, CD, BCD 
Ill C, AB, ABC, AD, ACD, BD, BCD 
IV D, AB, ABD, AC, ACD, BC, BCD 


These 4 replicates give 34 relative information on main effects, 14 rela- 
tive information on 2-factor interactions, 14 relative information on 3- 
factor interactions, and full relative information on the 4-factor inter- 
action. The design specified by these systems of confounding appears 
satisfactory for a situation in which an experimenter wishes to test 4 
factors each at 2 levels in blocks of 2 plots. The analysis is left as an 
exercise for the reader, since it presents no new difficulties. 
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It is sometimes possible to arrange the treatment combinations in 
the form of a Latin square such that interactions of no interest to the 
experimenter are confounded with rows and columns of the Latin square. 
It must be remembered that, in order to obtain an unbiased estimate of 
error from a Latin square, all rows and all columns must be rearranged 
in a random order. ‘Thus, we cannot arrange the experiment so that 
rows (or columns) forming each complete replication necessarily fall to- 
gether in the field. In this section we shall consider the various types 
applicable to sets of factors at 2 levels only. 


15.6.1 The 2? Design in Two 4 X 4 Latin Squares 

As we have seen, we can arrange € 23 design in blocks of 4 plots in 
such a way as to confound any 1 degree of freedom for treatments. So, 
in a 4 X 4 Latin square we may, considering rows as blocks, confound 
1 degree of freedom with rows, and then, considering columns as blocks, 
confound 1 degree of freedom with columns. Since 2 replicates are 
necessary to get an adequate estimate of error, we may completely con- 
found these 2 degrees of freedom, or we may partially confound 4 de- 
grees of freedom, or we may partially confound 2 degrees of freedom (say, 
two 2-factor interactions) and completely confound 1 degree of freedom, 
say, the 3-factor interaction. Examples of each follow. 
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Suppose we are testing all combinations of the 3 common fertilizers 
n, p, and k. The 8 treatments are: 


, n, p, np, k, nk, pk, npk 
1. If NPK is confounded with columns, PK with rows, both repli- 
cates will be randomizations of 1 of the 2 squares: 


(1) n pk npk () n pk npk 


np p nk k np k nk p 
or 

nk k np p nk p np k 

pk npk (1 n pk npk (1) n 


The reader may verify that the effects given are actually confounded. 
The analysis of variance appears in Table 15.7. 


TaBLE 15.7 
Due to 
Squares 
Rows within squares 
Columns within squares 
"Treatments 


acom 


* 
— —— 


Error 13 


Total 31 


It will perhaps be instructive to the reader to sketch the analysis of 
this design from the point of view of least squares. We shall take, for 
this purpose, the case of 2 replicates like the first square. The model 
we shall use is 


Vk = u + 5 + pij + Ya et 


where i denotes the square, j the row, k the column, | the treatment 
combination on plot (ijk), the other symbols having the obvious mean- 
ing. We may suppose that the rows and columns in each square are 
numbered in order as the rows and columns of the first square listed 
above. Then we may write, for example: 


/ 
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yur = +s + 911 + MM —4N - JP NVP - 3K + 3NK 
+ 4PK — NPK + ein 
9112 n T n +12 = = N= 4K NR 
IRT ÀNPK + en 
yam etaton Iu Ie 
+ }PK — ÀNPK + ens 
via = nta toat via FIN + IPTE ANP + 4K + INK 
+ 4PK VK + er 
and so on. It will be found that yi, Y21, Yrs: and y, always are asso- 
ciated with —14NPK, and the other column constants with T NPK. 
‘The least squares procedure may now be applied, and it will lead to the 
usual estimates of N, P, NP, K, and NK, which are orthogonal to 


squares, row and column estimates, and, hence, to the analysis of vari- 
ance given. 


2. If NPK, NP, NK, and PK are partially confounded, we get the 
results shown in Table 15.8. N 


Tapie 15.8 DesiGn ron 2! iN Two 4 X 4 Latin SQUARES 


Square I Square II 
(1) n pk npk Q p npk nk 
np p nkk np n k P 
nk k "pP npk nk (D P 
pk npk (1) n r 


ded NPK with columns and PK with 
i i i d NP with columns in repli- 
rows in replicate I, and NK with rows an 
cate II, so that NRK and NP are estimated from II only 5 va? 
NP from I only. We obtain full information on main xe ects $ / 
relative information on all the interactions, and the ysis of vari- 
in which the terms are computed in the ordi- 
nary fashion. The reader would be well advised to examine this de- 


sign also, from the poin 


In this case, we have confoun 
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Taste 15.9 ANaLvsis or DesiGn or TABLE 15.8 


Due to 

Reps 
Rows within reps 
Columns within reps 
"Treatments 

N 

P 

K 

NP 

NK 

PK 

NPK 
Error 11 


128 


— rA m mmm 


Total 31 


3. An example, completely confounding 1 degree of freedom and par- 
tially confounding 2 degrees of freedom is given in Table 15.10. 


Taste 15.10 DESIGN FOR 26 iN Two 4 * 4 LATIN SQUARES 


Square I Square IT 
(1) n pk npk (1) * np npk 
np p nk k nk n pk p 
nk k “npp np npk (I) k 
pk npk (1) n pk p nk n 


Here we have confounded NPK with columns in both squares and 
PK with rows in square I, NP with rows in square II. Thus we 


TABLE 15.11 ANALYSIS OF VARIANCE FOR DESIGN or TaBLE 15.10 


Due to 
^ Reps 
i Rows within reps 
Columns within reps 
Treatments 


osc- 


= 
* 


Error 12 


Total 31 
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have full information on N, P, K, NK; Jg relative information on NP 
and PK, and no information on NPK, NP being estimated from I and 
PK from II. 


15.6.2- The 2? Design in Three 4 X 4 Latin Squares 

With 3 squares the 3-factor interaction may be confounded with 
columns in all 3 squares and each 2-factor interaction confounded with 
rows in 1 square. Then we have 24 the relative information on the 
2-factor interactions. Alternatively, if 2-factor interactions are of the 
sume interest as main effects, we may confound each in 14 of a square, 
giving 56 the relative information on each effect except the 3-factor in- 
teraction which is confounded in all 3 replicates, as shown in Table 15.12. 


TanLE 15.12 DESIGN FOR 2° iN TunEE 4 X 4 Latin Squares 


Square I Square H Square HT 
N JO» p Pp P („) n nk k .qQn mp P, 
X lup n nk npk np p pk npk nk k pk npk 
vac e D ® np n nk k "pp. „ P nk mn 
ux? * UL. 
i npk () p n np’ npk (1) k 


Here NPK is confounded with columns in each replicate, while the 
effect, confounded in each row pair is indicated. N and NK are esti- 
mated from replicates II and III, P and PK from I and II, and K and 
NP from I and II. 


Taste 15.13 ANALYSIS OF VARIANCE OF DxsiGN or Taste 15.12 


Due to 

Reps 
Rows within reps 
Columns within reps 
Treatments 

N 

P 

K 

NP 

NK 

PK 
Error 21 


Total 47 


S S D 


——————- 


15.6.3 2! Design in 8 X 8 Latin Squares 
as we are considering only complete confounding of interac- 


Insofar ) 
the only other square layout to be consid- 


tions with rows or columns, 
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ered is the 8 X 8 square. Any 1 degree of freedom for a main effect or 
interaction may be confounded with rows, and, at the same time, an- 
other degree of freedom for a main effect or interaction may be con- 
founded with columns. Alternatively, partial confounding may be 
' adopted, each of 4 degrees of freedom for 3-factor interactions being con- 
founded in one of the 4 row pairs, and the 4-factor interaction being 
completely confounded in the 4 column pairs. Three quarters of the 
relative information will then be available on the 3-factor interactions. 

In Table 15.14, ABC, ABD, ACD, BCD are confounded with row 


Tapte 15.14 DESIGN ror 4 Factors IN AN 8 X 8 SQUARE 


I (1) d ab abd ac acd bc bed 
ad a dd b cd abe abd c 
u ab c (1) abe ad bed bd acd 
ac b te a abd abd cd d 
n ed abe ac bed (1) b ad abd 
bc acd abd c bd d ab a 
IV bd abd cd acd bc a (1) abe 
abd bed ad d ab c ac b 


pairs I, II, III, IV, respectively, and each may be estimated from those 
rows in which it is not confounded. ABCD is completely confounded 
with columns. Further partial confounding may be done as with 2* 
experiments. The structure of the analysis of variance for this example 
is given in Table 15.15. 


Tapie 15.15 ANALYSIS OF VARIANCE FoR DzsiGN or TAU 15.14 


Due to df 
Rows i 7 
Columns 7 
Treatments 14 


(One each for A, B, AB, C, 
AC, BC, ABC, D, AD, BD, 
ABD, CD, ACD, BCD) 
Error 35 


"Total 63 


15.6.4 Arrangements for 5 and 6 Factors in an 8 X 8 Square 


Yates! gives a balanced group of sets for confounding in a 2° design 
in blocks of 8 plots: 
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ABC ADE BCDE 
ABD BCE ACDE 
ACE BCD ABDE 
ACD BDE ABCE 
ABE CDE ABCD 


If only a single 8 X 8 square is available, 4 out of the 5 sets may be 
confounded, 2 with rows and 2 with columns. In the square in Table 
15.16 the first group is confounded in rows 1—4, the second in rows 5-8, 
the third iħ columns 1—4, the fourth in columns 5-8, and the fifth group 
is unconfounded. 
TABLE 15.16 
() abe be ace abd bede de acd 


bee ac e ab bed aude acde d 


ae b abd de ac cd bee abode 


The analysis is performed in the usual way, partially confounded in- 
teractions being estimated from the rows or columns in which they are 
unconfounded. As with all these designs in Latin squares, rows and 
columns must be completely randomized among themselves in order 
for an unbiased estimate of the error to be obtained. In the case of 6 
factors, the system of confounding will be of the.type: 


Rows ACE, ADF, BDE, BCF, ABCD, ABEF, CDEF 
Columns ABF, ADE, BCD, CEF, ABCE, ACDF, BDEF 


The square in Table 15.17 confounds these interactions. If 128 plots 
are available, a second square confounding a different set of 3-factor 
interactions may be obtained from the above square by transforming 
a to c, c to f, f to e, and e to a. Two 4-factor interactions will be con- 


ſounded in both squares (completely confounded). 


à 
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Tasik 15.17 
(1 ade bdf  abef cdef acf bee abed 
aef df abde b acd ce abcf — bedef 
bdef abf e ad be abcde cdf ace 
abd be af def abe bedf acde c 
cde ac beef abedf f adef bd abe 
acdf cef abc bede ae d abdef bf 
bef abcdef cd ace bde ab ef adf 
abce bed acdef cf ahl bef a de 


Yates has pointed out ? that there are some difficulties with this de- 
sign. Itis possible, with certain arrangements of the rows and columns, 
for the contrast representing one of the main effects to consist of the 
contrast between the diagonally opposite pairs of quarters of the whole 
square. This will occur with considerable frequency if rows and col- 
umns are randomized, as they should be. Yates makes tentative sug- 
gestions for overcoming this defect, but it is probably better in the 
present state of knowledge to avoid the design, or to replicate it.* 


15.7 DOUBLE CONFOUNDING 


This term is used to denote the arrangement of a set of factorial com- 
binations in a rectangular array, say, rows by columns, in such a way 
that interactions of little interest are confounded either with rows or 
with columns. With a 2" experiment, we shall have 2” rows and 2" 
columns. For 5 factors each at 2 levels we could use the arrangement 
given in Table 15.18 before randomization. 


TABLE 15.18 2° EXPERIMENT IN 4 X 8 PATTERN 
() ab de abde ace bee acd bed 
abe e abd d be ac bede acde 
ele abcde c abe ad bd ae be 
abd cd abce ce bde ade b a 


In the arrangement, ABC, CDE, ABDE are confounded with rows, 
and AB, CD, ABCD, BDE, ADE, BCE, and ACE are confounded with 


* See in this connection “Restricted randomization and quasi-Latin squares.” 
I. M. Grundy and M. J. R. Healy. J. Roy. Stat. Soc. (B), 12, 286-291, 1950. 
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columns. The design is simply obtained by writing down the intra- 
block subgroup corresponding to the row confounding in a row and the 
intrablock subgroup corresponding to the column confounding in the 
first column and taking products according to the usual rules. This 
particular design is of little value unless repeated, for the only means 
of estimating the error variance is to use unconfounded interactions in- 
volving 3 or more factors, so that only 8 degrees of freedom are avail- 
able. In repetitions it would be well to use different schemes of con- 
founding so that some within-row-and-column information could be ob- 
tained on all effects and interactions. The general value of such de- 
signs is limited because it is necessary to assume that row effects are 
constant over all columns, and the minimum number of columns is 8. 
If long rectangular plots are used, the design could, however, be valua- 
ble for field experiments. The designs in Latin squares are, of course, 
a particular case of the general class discussed in this section. 


15.8 MISSING VALUES IN FACTORIAL EXPERIMENTS 


Unconfounded factorial experiments present no new problem. Fac- 
torial experiments in which only complete confounding is used may be 
“filled in" in a simple way. Considering the case of 1 missing plot in 
1 block of 1 replicate, we may obtain the difference between the mean 
of the other treatments of this block and the missing treatment in the 
other replicates and apply this to the mean of the treatments represented 
in the block to give an estimated value for the missing observation. 
Thus, suppose we had 2 replicates, and the 2 relevant blocks are as 


(1) 8 
npk 9 


ks 10 
nps Missing 


Figure 18. 


shown in Figure 18, then the estimated value is 


14 
er, (ig ZEEE) - opas rp si 
3 


This value may be inserted for purposes of estimation. For tests of 


significance and estimation of the error of estimates, the position is* 
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more complex, and it will, for most purposes and with large experiments 
(say, involving 4 or more factors), be sufficient for us to reduce the error 
degrees of freedom by the number of missing plots before the error 
mean square is obtained and, thenceforth, to disregard the fact that 
any observations were missing. 

In partially confounded experiments the situation is more complex. 
We can certainly follow the usual procedure of inserting algebraic values 
for the missing values and then minimizing the error sum of squares 
with respect to these algebraic values. This procedure could be very 
tedious, and a simpler approximate device would be to find other blocks 
containing the missing combination and some of the other combina- 
tions of the block with the missing observation, and perform a calcula- 
tion like the above for the complete confounding case. 
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CHAPTER 16 


Experiments Involving 
Factors with 3 Levels 


16.1 INTRODUCTION 


In the case of factors each at 2 levels, we have seen that the differ- 
ences between yields of treatment combinations may be expressed simply 
in terms of main effects and interactions. This simplicity arises because 
each factor has 2 levels, and the effect of any 1 factor may be expressed 
by 1 figure, the yield with the factor at the higher level minus the yield 
with the factor at the lower level. With factors at 3 levels, we can ex- 
press the effect of a factor in' 2 ways. First, we can express the yield 
at each level as a deviation from the mean yield at the 3 levels, giving, 
say, Ao, A1, and As, where Ao + Ai + 42 = 0. This method is useful 
mathematically, as will be seen later in that symmetry properties are 
retained. 

The experimenter is however more likely to be interested in the other 
method. We suppose that the 3 levels of a factor, say, 0, 1, 2, corre- 
spond to amounts of a factor (e.g., fertilizer 0, 1, and 2 cwt per acre). 
Suppose these yields are plotted on a graph as in Figure 19. 


1 az-a; 


1 
Amount of factor 


Yield 


40 


Figure 19. 


There are 2 responses to a unit amount of the factor, a, — ao at the 
level O, and a; — a, at the level 1. We may take the sum of these us 
the average effect of the factor, i.e, [(ua — a1) + (a, — ao)! which 
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equals (ay — ao). As a measure of the extent to which the response is 
falling off as the level increases, we may take (az — ai) — (a, — ao) 
which equals dz — 2a; + ao. We therefore define the linear effect of 
the factor a by 

i A’ = (a — ao) 
and the quadratic effect by 


A" = (as — 2a, + ao) 


"These may be derived apart from constant divisors by regression theory if 
one wishes. The linear regression coefficient of yield on amount of factor 
is equal to (ag — a9)/2 corresponding to E(x — z)(y — j)/Z(x — x)? for 
the linear regression of y on x. The quadratic effect is the linear contrast 
among ao, di, dz, Which is orthogonal to the linear effect ( — ao). In 
passing it may be noted that, if the a levels do not correspond to equal 
spacing, it may be preferable to define the linear effect differently (ac- 
cording to the regression approach) and the quadratic effect correspond- 
ingly. À 

Now consider 2 factors, a, b, each at 3 levels, which we denote by sub- 
scripts 0, 1, and 2. The interaction of these 2 factors will be the inter- 
action of a 3 X 3 table and will have 4 degrees of freedom. These 4 
degrees of freedom may be separatéd into contrasts each with a single 
degree of freedom in many ways. The most useful in the interpretation 
of experiments is the following: 


A'B' = }(a2 — ao)(bz — bo) 
` A"B' = $ (az — 2a, + ag) (by — bo) 
A'B" = 10 — ao)(bz — 2b, + bo) 
A"B" = $ (az — 2a, + 400 (% — 2b, + bo) 


each having 1 degree of freedom. The choice of a divisor in each of 
these expressions is a matter of convention entirely. Throughout we 
have used the convention that any effect or interaction is to be expressed 
on the basis of the difference between 2 plots, and we shall adhere to 
this rule. 

This system for expressing the results may be extended indefinitely. 


Thus, for 3 factors, a, b, and c, we shall have 26 degrees of freedom of 
the following types: 
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3 linear effects: e.g., $(as — ao)(bo + b + ba) (co + ei + ez) = A" 

3 quadratic effects: e.g., PS (d — 2a, + ao)(bo + bi + be) (co + cı + 
c2) = A" 

3 linear X linear interactions: e.g., (a2 — dc) (b — bo)(co + cı + cz) 
= A'B' 

6 linear X quadratic interactions: e.g., 3!3(a» — 40) (bo — 2b, + bo) X 
(co + ci + ez) = A'B" 

3 quadratie X quadratic interactions: e.g., 21 (u — 2a; — 400 (b2 — 
2b, — bo) (eo + c1 + c) = A"B" 

1 linear X linear X linear interaction: }(az — do) (b — bo) (e — co) = 
A'B'C' 

3 linear X linear X quadratic interactions: e.g., 3 (4 — ao)(bo — bo) 
X (co — 201 + ez) = A'B'C" 

3 linear X quadratic X quadratic interactions: e.g, TU ( — 40) (be 
— 251 + bo) X (ca — 2e + co) = A'B"C" 

1 quadratie X quadratie X quadratic interaction: gig (42 — 2a, + ao) 
X (by — 2b, + bo) (Co — 2e + c  A"B"C" 


The value of this system depends entirely on the presupposition that 
the factors will be largely linear in their effects and that interactions 
involving quadratic effects will be less important. ‘This is frequently 
the case, though the above procedure must be regarded as an easily 
understood approximation to the facts, just as the use of effects and low- 
order interactions for factors at 2 levels is an approximation, as was 


noted in Chapter 13. 


16.2 THE FORMAL METHOD OF DEFINING EFFECTS AND 
INTERACTIONS 


We shall introduce this method by an intuitive argument. Consider 
first the case of 2 factors, a, b, each at 2 levels, 0 and 1. The 4 treat- 
ment combinations may be represented by the points (0, 0), (1, 0), 
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(O, 1), and (1, 1) on the Euclidean plane with axes z;, x2, the first co- 
ordinate referring to the level of a and the second to the level of b. 
The effects and interactions defined in previous chapters have a simple 
algebraic interpretation. The effect of A is, for example, the compar- 
ison of treatment combinations for which z; = O against those for which 
zı = 1. Likewise, the B effect is the comparison of those treatment 
combinations for which z2 = 0 versus those for which zz = 1. The inter- 
action is in the former notation, the comparison among treatment com- 
binations. 
(I) Tab - a- b 


i.e., of the points (0, 0) and (1, 1) versus the points (1, 0) and (0, 1). 
For the first point (0, 0), ‘ 
ET! + 12 0 


and, for the second (1, 1), 

z; ＋ 22 2 
and, for the other 2 points, 

11 ＋ 22 1 


If we work with numbers reduced modulo 2, that is, we replace any 
number by the remainder when it is divided by 2, the interaction is the 
comparison of those treatment combinations for which 


11 + z2 0 mod 2 
versus those for which 
41 ＋ 22 Ä 1 mod 2 


With 3 factors, a, b, e, each at 2 levels, we represent the treatment com- 
binations by a point in 3-dimensional space (zi, £2, z3). Thus: 


(1) = (0,0,0); a= (1,0,0); b= (0,1,0); ab = (1, 1, 0) 
c = (0,0, 1); ac = (1,0, 1); be = (0, 1, 1); abc = (1, 1, 1) 


It is easily verified (and follows from the relations of evenness of num- 
ber of letters in common between treatment symbols and symbols for 
effect and interaction) that the effects and interactions are based on a 
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comparison of 2 groups of the treatment combinations given by the 
equations in Table 16.1. 
TaBLE 16.1 
Effect or Left-Hand Side 
Interaction of Equation 


A Ti 
B 12 
AB zi +22 
[^] T3 
AC zı + T3 
BC 12 + T3 


ABC Tı r2 + T3 


For example, the treatment combinations entering the ABC nega- 
tively are (1), ab, ac, and be, and for these zı + £2 + 73 equals 0, 2, 2, 
and 2, respectively: in other words it equals 0 modulo 2. The treatment 
combinations entering positively are a, b, c, and abe, and for these 
2 + 42 + 23 equals 1, I, 1, and 3, respectively, or equals 1 modulo 2 
for each treatment combination. It is a simple matter to derive the 
rule of the generalized interaction with this notation. 

The above approach for the 2" system suggests the appropriate ap- 
proach for the 3" system. Consider the arrangement of the 9 treatment 
combinations with 2 factors. Tov ufa 

—— n 
0,0) (1,0) 2, 0) 


Level of b (00 , 1) , 1) 
(02 (, 2) 2, 2) 

The main effect of a will be represented by the comparisons among 3 
means: those for which zı = 0, for which z; = 1, and for which x, = 2. 
The representation of these effects as 2 linearly independent numbers 
may be obtained by considering each mean as a deviation from the 
over-all mean. Likewise, the main effect of b will be represented by the 
comparison among the 3 means, those for which zz = 0, 22 = 1, and 
12 = 2. The interaction of the factors a and b we know to have 4 de- 
grees of freedom. We can consider these 4 degrees of freedom from the 
point of view of the completely orthogonalized 3 X 3 square. If we 
insert Latin and Greek letters so as to get a completely orthogonalized 
square, we have the square: 

Aa B8 Cy 
By Ca AB 
C8 Ay Ba 
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The comparison among columns gives the effect of a, among rows the 
effect of b. Those among Latin letters and those among Greek letters 
each with 2 degrees of freedom represent the 4 degrees of freedom for 
the interaction of the 2 factors. Consider the grouping given by Latin 
letters, namely: 

(0, 0), (2, 1), and (1, 2) 


versus (I, 0), (0, 1), and (2, 2) 
versus (2, 0), (0, 2), and (1, 1) 


For the first set of 3 treatment combinations, 21 + zə takes on the value 
0, 3, and 3, i.e., O modulo 3; for the second set, x; + x2 takes on the 
values 1, 1, and 4, i.e., 1 modulo 3; and, for the third set, æ1 + A equals 
2, 2, and 2. So 2 degrees of freedom are given by the comparisons among 
plots for which z, + zə = 0, = 1, = 2 mod 3. 

Similarly, the Greek letters give the grouping: 


(0, 0), (1, 1), and (2, 2) 
versus (I, 0), (2, 1), and (0, 2) 
versus (2, 0), (0, 1), and (1, 2) 


The function z; + 2 modulo 3 takes on the value 0 for the first group, 
1 for the second, and 2 for the third (1 + 2 X 2 = 5 = 2 mod 3). 

In summary then, the effects and interactions for 3? design are given 
in pairs of degrees of freedom by the comparisons among 3 sets of treat- 
ment combinations, as follows: 


A: 2020, 


1, d 2, 
B: 12 =0,=1,=2, od 3 
m 
Interaction [^ „ 
2; + 272 = 0, = 1, = 2. 


It is convenient to denote the pair of degrees of freedom correspond- 
ing to the equations zı + x2 = 0, = 1, = 2 by the symbol AB and the 
pair corresponding to x; ＋ 272 = 0, = 1, = 2 by 42. The inter- 
action degrees of freedom may also be represented by BA and BA?, 
respectively. The pair of degrees of freedom corresponding to BA are 
given by the contrasts among the 3 groups of treatment combinations 
for which 

12 ＋ 41 0 


42 + 21 = 1}mod 3 
42 +2 = 2. 


and 
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and these equations are identical with those specifying the groups that 
give the interaction degrees of freedom denoted above by AB. The 
interaction degrees of freedom corresponding to BA? are given by the 
contrasts among the 3 sets of treatment combinations specified by the 


equations: 
29 ＋ 21 = 0 


X2 + 2n = ]imod 3 
29-21, = 2 
But the solutions of the equation 
T2 + 21 = mod 3 
are the same as the solutions of the equation: 


2( 12 + 27,) = 0 mod 3 


i. e., 
22 + 42, = 0 mod 3 


ie., 
tı + 2x. = 0 mod 3 
Similarly, the solutions of the equation 
12 + 2x, = mod 3 
are the same as the solutions of the equation 


22 + x, = 2 mod 3 


and the solutions of the equation 


12 + 2r, = 2 mod 3 


are the same as those of 
22 + 51 = 1 mod 3 


AB? and BA? are the same, and the 
sum of squares will be the same, being that ascribable to differences 
among the 3 groups. It is convenient, in order to obtain a complete and 
unique enumeration of the pairs of degrees of freedom, to adopt the rule: 
that an order of the letters is to be chosen in advance and that the power 
of the first letter in a symbol must be unity. This latter is obtained by 
taking the square of the symbol with the rule that the cube of any letter 
is to be replaced by unity, if the initial letter of the symbol occurs raised 


to the power of 2. 


The groups given by the symbols 
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We may extend this process indefinitely. For 3 factors we have the 
results shown in Table 16.2, where only the left-hand side of the equa- 
tion is written down in each case. 


Tase 16.2 
Effect or 
Interaction Equation 
A 11 
B 12 
AB 11 ＋ 12 
AB? zı + 22 
[^] 15 
40 zi +23 
AC? zı + 2x3 
BC 72 + T3 
BC? z} + 2z3 
ABC zi ＋ 12 +23 
ABC? 21 +22 22 
AB'C 11 + 272 + 23 


AB 11 + 223 + 2x3 


Note that the 8 degrees of freedom for the 3-factor interaction break 
down into 4 sets of 2 degrees of freedom. This may be shown (cf. 
Fisher ') by considering the 3 X 3 Latin square. 

The 4-factor interactions of 4 factors each at 3 levels correspondingly 
breaks down into 8 sets of 2 degrees of freedom, which may be denoted 
a5 in Table 16.3. 


Taste 16.3 
Symbol Equation (LHS only) 
ABCD 11 ＋ 21 +23 bon 
ABCD* zi +22 + 23 2n 
ABCD 11 +22 + 2x3 + 24 
ABC*D* 71 ＋ 22 + 273 + 24 
AB'CD zı + 2n + 25 + r 
AB'CD* zi 2ra + 2 + 2r 
ABCD - 71 + 2ra + 27 + 2% 
A zı + 2n + 2ra + 27 


The extensions are quite straightforward and will not be enumerated. 
For the 3" system we shall have (3" — 1)/2 symbols, each representing 
2 degrees of freedom. 

In presenting the above we have relied on intuitional generalization. 
The properties indicated are easily proved and will be presented for the 
general p” system in the next chapter. 
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16.2.1 Yields of Treatment Combinations in Terms of Effects and 


Interactions 


The symbols used above to denote pairs of degrees of freedom will 
also be used to denote the magnitudes of effects and interactions in the 
following way. Each symbol represents a division of the 3" treatment 
combinations into 3 groups of 3"! treatment combinations. The sym- 
bol, with a subscript which is at the right-hand side of the equation 
determining the particular one of the 3 groups in which treatment com- 
binations lie, will denote the mean yield of that group as a deviation 
from the mean. Thus, e.g.: 


40 = (mean of treatment combinations containing ag) — (mean 

of all treatment combinations) 

AB, = (mean of treatment combinations for which z; + 22 
= 0 mod 3) — (mean of all treatment combinations) 

AB, = (mean of treatment combinations for which x, + 22 
= 1 mod 3) — (mean of all treatment combinations) 

AB?’C, = (mean of treatment combinations for which 2; + 22 + %3 = 

1 mod 3) — (mean of all treatment combinations) 


With these definitions the yield of a treatment combination a;bjcy in 
terms of effects and interactions is 


ajbjc, = u + A; + Bj + AB. AB? ;49; + Ck 
+ AC + AC ua + BCj + BC? ; 40% + ABC 
+ ABC IU + ABC + AB?C?; oj ok 

where all subscripts are reduced modulo 3, and u is the mean of all com- 
binations. For example, the yield of the treatment combination a,b,co 
is given by 
aibitz = i +A, + Bı + 4B: + AB? + C2 + ACo + 4073 

+ BC, + BC. + ABC; + ABC’ + ABC; + AB*C?, 
Given this rule it is possible to express any linear contrast of the yields 


of the treatment combinations in terms of the effects and interactions. 


The process appears somewhat complex but is in fact very simple to 


operate, once one acquires the rules of reduction modulo 3: i.e., that 


every subscript is to be divided by 3 and the remainder substituted. 
It may be noted that this reparametrization of the general linear hypoth- 
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esis model is not of full rank, in that Ao + A1 + Ag = 0, for example 
(see Chapter 6). If a reparametrization of full rank were used, the sym- 
metry in the equation for a;5;c; could not be retained. 

Now suppose that the treatment combinations are tested the same 
number of times in a randomized block trial. "Then the yield of a treat- 
ment combination will, under additivity, be equal to the true yield plus 
an error. The errors may be regarded as uncorrelated, and the best 
estimate of any contrast of the true yields is the same contrast of ob- 
served means. It is easily verified that the estimates of quantities 
a; — oj and 8, — Bi, where a, 8 are different ones of the set of symbols 
A, B, AB, AB?, ABC, etc., and the i, j, k, l have values equal to 0, 1, 
or 2, are uncorrelated. 


163 CONFOUNDING 


We came across the notion of generalized interaction for 2" experi- 
ments, namely, that, if effects or interactions represented by X and Y 
are confounded, so is XY, obtained by multiplying the symbols together, 
eliminating common letters (or what amounts to the same thing) equat- 
ing the square of any letter to unity. This notion enabled an easy enu- 
meration of systems of confounding. 

In the 3" system we have noted that the 3" — 1 degrees of freedom 
may be broken down into (3" — 1)/2 sets of 2 degrees of freedom, to 
each set of which we have attached a symbol. We note also that the 
interaction of 2 effects consists of 2 pairs of degrees of freedom; the 
interaction of A and B being AB and AB?. The rule of the generalized 
interaction for the 3" system is that, if pairs of degrees of freedom cor- 
responding to X and Y are completely confounded, then so are the pairs 
of degrees of freedom corresponding to XY and X Y?, where the rule of 
multiplication is the ordinary commutative one with the condition that 
the cube of any letter is to be equated to unity. The ambiguity which 
could apparently arise if a different order were taken is nonexistent, be- 
cause the effect or interaction given by, say, the comparison of treat- 
ment-combinations for which Nit + Agra + Mara . . 2 0, = 1, = 2 
is the same as that given by the comparison of treatment combinations 
for which Ni + 2455 + NN P.. . 2 0, = 2, =1. We have 
adopted the rule that, in any symbol, the power of the first letter should 
be unity. If a multiplication results then in 4500, say, we replace 
this by (A*BCD)* = A*B'C?D? = AB?C?D?. In this way we achieve 
a complete and unique specification of all the effects and interactions. 

An example of the use of this symbolism is the following. Suppose 
we wish to arrange a 3° experiment in blocks of 3. A complete list of 


8 


CONFOUNDING 


the 13 systems of confounding is given in Table 16.4, in each system 4 
pairs of degrees of freedom being confounded. For example, if AB and 
AC? are confounded, so is 


AB x AC? = A? BC? = A*B?C* = AB?*C 
and also 
AB x AC?AC? = A = BC 


TABLE 16.4 Systems or CONFOUNDING For 3? EXPERIMENT IN BLOCKS or 3 


ABC | AB'C | ABC? | AB'C* 


8 
z z 
z z 
z z 
z z 
z z 
z 
T 
z z 
9 z 
z 


The composition of the blocks is easily obtained from the definition 
of the effects and interactions. We take for illustration the case when 
AB, AC?, ABC, and BC are confounded. There are 9 blocks given by 


the solutions of the equations, et 
11 ＋ 12 = i mod 3 O 


zı + 2x3 = j mod 3 


where i, j each take on the values 0, 1, and 2. There 2 are bei 9 pairs: J, 


of equations, each pair giving 1 block. The block 1 the con- 
trol (aoboco) is that for which the equations, 
oJ 


190 


% 

d 
2 
q 


& 
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zi + z; = 0 mod 3 
and 
zı + 21; = 0 mod 3 


are satisfied, because these equations are obviously satisfied when æ1 = 
Z9 = 23 = 0. The set of treatment combinations satisfying these equa- 
tions is the intrablock subgroup. When z; = 1, x2 must equal 2, be- 
cause 1 + 2 = 3 = 0 mod 3, and æz must equal 1, because 1 + 2 X 1 = 
3 — 0 mod 3. One of the other treatment combinations in the block is 
therefore aibzei. When z, = 2, z; must equal 1(2 + 1 = 3 = 0 mod 3), 
and x3 must equal 2(2 + 2 X 2 = 6 = 0 mod 3). The third treatment 
combination is then a5b;c so that the block containing the control con- 
sists of the 3 combinations, aoboco, a1boc;, and agb4co. 
Another block is given by the equations, 


zı + t2 = 0 mod 3 
zı + 2x3 = 1 mod 3 


and we may get this block by adding (modulo 2) 2 to the level of zg in 
the control block, because, if 21 + 2z3 = 0 mod 3, then z; + 2(z3 + 2) 
= 1mod3. In a similar way, we generate the 9 blocks, where we repre- 
sent the treatment combinations by the subscripts only: 


I II III IV Y VI VII VII IX 
000 002 001 010 012 011 0²⁰ 022 021 
121 120 122 101 100 102 111 110 112 
212 21 210 222 221 220 202 201 200 


164 USEFUL SYSTEMS OF CONFOUNDING FOR 
3" EXPERIMENTS 


A We now proceed to list the more useful designs utilizing confounding 
involving factors at 3 levels. 


16.41 2 Factors 


We can confound any pair of effect or interaction degrees of freedom. 
If we were equally interested in main effects and interactions, we would 
use a basic pattern of 4 replicates with the following confounding: 


14 Blocks 00, 01, 02; 10, 11, 12; 20, 21, 22 
H B Blocks—00, 10, 20; 01, 11, 21; 02, 12, 22 
II AB  Blocks—00, 12, 21; 01, 10, 22; 02, 11, 20 
IV AB? Blocks—00, 11, 22; 02, 10, 21; 01, 12, 20 


With r repetitions of this basic pattern, that is, 4r replicates in all, we 
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would have the partition of the degrees of freedom shown in Table 16.5, 
the sums of squares being obtained in the usual way. 


TaBe 16.5 
df 

Replicates 4 — 1 

Blocks within replicates 8r 

A 2 

B 2 

AB 2 

AB? 2 
Error 24r — 8 
36r—1 


The error sum of squares will be made up of the following: 
A by replicates of types II, IIT, and IV with 2(3r — 1) df. 
B by replicates of types I, III, and IV with 2(3r — 1) df. 
AB by replicates of types I, II, and IV with 2(3r — 1) df. 
AB? by replicates of types I, II, and III with 2(3r — 1) df. 


We are always interested in the magnitude of the effects and interactions, 
or of particular treatment contrasts, and it is found that these are ex- 
pressible in terms of differences of the type 


AXo + uX1 2 


where à + u +» = 0, and X is one of the effect or interaction symbols. 
The variance of any such quantity will be (A? + 4? + 7°) X (variance 
of the mean of the plots which fall into any one group defined by a linear 
relation of the form Ze;z; = j mod 3). The reciprocal of the variance 
of the mean of such plots will therefore be used as a measure of the in- 
formation on the effect or interaction. Thus, if ABC is confounded in 
1 of 4 replicates, the quantity ABC; i = 0, 1, 2 is (the mean of 27 plots 


— mean of 81 plots). The mean of the 27 plots will have variance 5 
1 s n 3 
= 36 * and the information is 373 4 * rt 


'The comparison of the above confounded design with a design using 
blocks of 9 and, hence, no confounding is given in Table 16.6, where 
c?4 and c^, are the experimental error variance with blocks of 3 plots 


and blocks of 9 plots, respectively. 
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TABLE 16.6 INFORMATION 


> : Relative Information 
Above Design | No Confounding Mida) ey: moy 


A 

B or 12r 3 
AB 0˙3 0˙5 4 
AB? 


Now suppose we wished to obtain the maximum information possible 
on main effects. We would then use a basic pattern of 2 replicates: 
namely, types IIT and IV. The analysis of variance for such an experi- 
ment presents no difficulties, and the relative information on main ef- 
fects will be unity and on each of the interactions 14. This results in 


information on A and B of 12r/c?, units, and on AB and AB? of 6r/c?3 
units. 


16.4.2 3 Factors 


1. Blocks of 9 Plots. With blocks of 9 plots the most useful experi- 
ment consists of one or more repetitions of a basic pattern of 4 replicates 
confounding ABC, ABC?, AB?C, and AB?C?, respectively. This will 
result in full information on all main effects and 2-factor interactions 
with 34 information on the 3-factor interaction. If the experiment, is to 
use 2 replicates, any 2 of the 4 pairs of interaction degrees of freedom 
may be chosen for confounding. The blocks for each of the 4 confound- 
ings are given in Table 16.7, the level of c being in the body of the table, 
each column giving a block and each set of 3 columns a replicate. 


Taste 16.7 Destans ror 3? Exreriment IN. BLocks or 9 
CoxrovspEp DEGREES OF FREEDOM 


Level Level of c 

of ————— pim 
e ABC ABC? ABC — ABC 
00 9115221013:1950 12^ 0 2 1 
10 OF POS) *$ 06 102 
2 0 rs 210 
0 1 SE0-1 094 "1*4 $310 
l1 1c 619 0231] 
T 1 CA T D5.31''s qv 16 3 
0 2 [aoe eS 0 t 1903 
12 1221 0 
2 2 2:0 130974 08.1 2 .0 3 1 
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The effect of changing the order of the letters in the definitions is 
easily found. One reason for preferring the notation we use over that 
of Yates? is this, the other being the ease of representation of all facets 
of the situation. Thus: 


ABC = BCA = CAB 
ABC? = B@A = CAB = CB 
AB?C = BA = BCA? = CAB? = CB 


The definition of these interactions by the equations in the treatment 
combinations suggests the appropriate computational procedure. For 
example, the treatment combinations for which zı + 22 + 23 = 0 mod 3 
are those for which 


11 + % = O, 13 = 0 
or 

a, +2 = 1, 23 = 2 
or 

41 + 12 = 2, 13 =1 


In order to obtain the 3-factor interactions, we therefore obtain the two 
2-factor interaction contrasts at each level of the third factor and then 
form the interaction of these with the third factor. Numerical examples 


will be given later. 

In the same way that we evaluate the relative information on effects 
and interactions which a confounded design gives, we may obtain the 
information given by the confounded design relative to that of the un- 
confounded design on any treatment comparison. As an example we 
take the comparison (aoboco — aghoci). Now the estimated yield in 
terms of estimated effects and interactions of the combination agboco is 


aoboco = mean + Ao + Bo + ABo + AB?» + Co + 400 + AC? 
+ BCo + BC% + ABCy + ABC? + AB*Co + ABC 
and of doboe is 
aoboci = mean + Ao +.Bo + ABo + AB, + C, + 401 + 4025 
+ BC, + BO + ABC, + ABC + AB'C, + AB?C?, 
so that the estimate of (aoboco — aoboc1) is 
(agboco — aoboci) = (Co — Ci) + (ACo — AC) + (40° — AC*2) 
+ (BCy — BC) + (BC%) — BO + (ABC, — ABC,) 
+ (ABC*, A BC?*;) + (ABC A B2CI) + (A487 — A 202.) 
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Each quantity in parentheses is estimated independently of the others, 
with a variance depending on the system of confounding used. If a 
multiple r of 2 replicates were used, confounding ABC in r replicates 
and A BC? in r replicates, the relative information and variance for each 
effect and interaction would be as given in Table 16.8. . 


TABLe 16.8 
Relative 
Information Variance 
Main effects 
2-factor interactions 1 c*/l8r 
ABC, ABO 
ABC, ABC* Xx o°/9r 


The variance of (Co — Ci) is then 20% 187 and so on, so that the vari- 
ance of (aoboco — agboci) is je: 


5 
18r AON: 


With no confounding and the same error variance, the variance of the 
comparison would have been c?/r, so that the relative information on 
this comparison is 941. 

2. Blocks of 3 Plots. The number of different systems of confounding 
in blocks of 3 plots is 13-12/4-3 = 13. The complete list of these was 
given in Table 16.4. Suitable confounding for a 3? experiment in blocks 
of 3 would be the following: 


I. AB, AC, BC?, AB?C? 
II AB, AC, BC, ABC? 
IH AB, AC*, BC, 420 
IV AB’, AC?, BC?, ABC 


With r repetitions of these 4 replicates, the partition of the degrees of 
freedom in the analysis of variance would be as shown in Table 16.9. 


TABLE 16.9 
Source df 
Replicates 4r—1 
Blocks within replicates 32r 


A, B,C 
AB, AB*, AC, AC?, BC, BC? 26 
ABC, AB*C, AB, AB?C? 
T 


Total 108r — 1 
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The relative information and variances are as given in Table 16.10. 
Taste 16.10 


Relative Variance with Variance with 
Information Blocks of 27 Above Design 


Main effects 1 6/307 
2-factor interactions M 2 307 9/187 
3-factor interactions 94 % Tr 


In many cases it may be anticipated that the gain in information re- 
sulting from lower variance with blocks of 3 plots relative to blocks of 
27 plots would outweigh the loss in relative information resulting from 
the confounding. It should be noted that, in all the cases discussed in 
this and the previous two chapters, we have not considered the utiliza- 
tion of the information on effects and/or interactions given by block 
comparisons. This problem will be discussed in a later chapter on 
quasifactorial designs. For most of the designs we have discussed, the 
information contained in block comparisons will be rather trivial. 


16.4.3 4 Factors 

1. Blocks of 27 Plots. In general, the experimenter will wish to avoid 
blocks of size as large as 27, though, in some fields of experimentation 
and with some types of experimental material, the effect on error vari- 
ance of reducing block size from 27 to 9 may be so small as not to offset 
any loss in relative information which will result from confounding. 
With 4 factors each at 3 levels in blocks of 27 plots, any of the 8 pairs 
of degrees of freedom of the 4-factor interactions may be confounded. 
These are as given earlier represented by the symbols ABCD, ABCD”, 
ABC?D, ABC?D?, AB°CD, AB?CD?, ABCD, and ABCD. The 
actual design may be simply constructed by reference to the linear 
equations which define the interactions. Thus, if we confound AB?CD?, 
the intrablock subgroup will consist of the treatment combinations 
G5 beer dz,, Where T1, 42, T3, T4 satisfy the equation 


11 + 272 + 23 + 2x4 = 0 mod 3, 


The other 2 blocks are obtained by substituting 1 and 2, respectively, 
on the right-hand side of the equation. The solution of these equations 
is simple, but it is perhaps worth while to give an example. Taking the 
above equation then, we know that a solution exists for every value of 
24, 42, and z3, and so we choose particular values for these and solve 
the equation for 24. When, for example, z; = 0, 12 = 0, z3 = 0, we 
have 


x 
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0 4- 2 X 0 4- 0 4- 2z, = 0 mod 3 


and so z4 = 0. When 


we have 
ie., 
i.e., 
i.e., 


and so on. 


41 =1, 19 = 2, 43 = 2 
1＋ 47 27 2x, = 0 mod 3 


74-21, = O mod 3 
1 4-27, = 0 mod 3 


% = 1 because 14-223 = 0 mod 3 


2. Blocks of 9 Plots. The 130 systems of confounding are of the fol- 


lowing types: 


„ AB n AB 
A, BC, ABC, ABC? 
A, BCD, ABCD, AB?C?D? 
AB, AC, BC?, ABC 
AB, CD, ABCD, ABC?D? 
AB, ACD, BC?D?, AB?C?D? 
ABD, ACD?, ABO, BC?D? 


The most useful type of confounding is obviously the last one and is 
the basis of the design given by Yates.? There are in all 8 such systems 


of the type 


ABO, AC h, ete., etc. 


because i, j, k may each take the values 1 or 2. We give as an example 
the design in which ABD, ACD?, ABC, and BC?D? are confounded 
(Table 16.11). The others are obtained by simple operations on the 


superscripts. 


Tasty 16.11 


3! Brocks or 9: Coxrounpine ABD, ACD?, AB?C?, anv HU 


H IL IV V VI EMI IX 
1000 0100 0010 0001 2000 0200 0020 0002 
2101 120 111 1102 0101 1001 1121 1100 
0202 2002 2212 2200 1202 2102 2222 2201 
1122 0222 0102 0120 2122 0022 0112 0121 
1211 001 0221 0212 221 0111 0201 0210 
2012 1112 1022 1010 0012 1212 1002 1011 
2220 1020 1200 1221 0220 1120 1210 1222 
0110 2210 2120 214 110 2010 2100 2112 
0021 2121 2001 2022 1021 2221 2011 2020 
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3. Blocks of 3 Plots. It would be somewhat tedious (though quite 
straightforward) to enumerate all the possible types of confounding for 
this case. It is impossible to avoid confounding a main effect, so that 
we might use the following set of 4 replicates confounding 


I A, BC, BD and their interactions 
II B, AC, AD? and their interactions 
IH C, AB, AD* and their interactions 
IV D, AB, AC? and their interactions 


The complete set of effects and interactions confounded in I is as follows: 
A, BC, ABC, ABO, BD, ABD, AB?D? 
CD, BC?D?, ABCD, 40, AC?D, and ABC?D* 


This design will result in 34 information on main effects and 34 infor- 
mation on all the 2-factor interaction pairs of degrees of freedom. 


16.4.4 5 Factors 

For most purposes 243 plots in a block is entirely too many, so that 
it is of little value to consider unconfounded designs. Blocks of 81 plots 
are subject to the same objection, and we would not often use blocks 
of 27. In the latter case it may be shown that it is not possible to find 
a design confounding only 4- and 5-factor interactions. If a 5-factor 
interaction is confounded, at least two 3-factor interactions will be con- 
founded, if no 1- or 2-factor interaction is to be confounded. It is pos- 
sible, however, to confound one 3-factor interaction and three 4-factor 
interactions. An example of this is the design confounding ABC, 
AB?DE, A0, and BC?DE. 

Likely, the most useful confounded 3° designs are those confounding 
in blocks of 9. These have the disadvantage that it is not possible to 
avoid confounding a main effect or 2-factor interaction. Designs could 
be based on the confounding of ACE?, AD?E, AB?CE, ABD?E?, 
BODE, ABC?DE, AC?D, CDE, ABC, BE, BC?D?, A HCD, AB?D?, 
and permutations of this set. 


16.5 AN EXAMPLE 


The experiment * is concerned with the effect of sowing date, spacing 
of rows, and sulphate of ammonia on sugar beets. Blocks of 9 plots 
were used. Table 16.12 shows the plan and percent sugar, the third 
and sixth columns give coded values obtained by the equation x = 
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100(y — 16), where y is the percent sugar. "Treatments are as follows: 


Sowing Sulphate of 
Dates d Spacing s Ammonia n 
March 15 0 10-inch 0 None 0 
April 18 1 15-inch 1 O3cwtN 1 
May 16 2 20-inch 2 0.6 cwt N 2 


This example is described solely to present the computational procedure. 


TABLE 16.12 PLAN AND PERCENT SUGAR 


388888288 


Note that the interaction DS2N is confounded in the 


lef li- 
cate, and that DS*N? is confounded in the right-hand eft-hand repli 


replicate. 
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In computing the analysis of variance, first separate out the data to 
form Table 16.13, by summing over replicates. 


TABLE 16.13 Sums OVER REPLICATES 


no ny ne 
80 s 82 & 8 88 80 "n " 
do 120 63 71 127 158 106 100 80 54 
di 173 106 170 80 109 123 123 56 109 
dy 86 193 164 92 139 104 92 101 60 


'The next step is to obtain the total sum of squares, the sum of squares 
for blocks, and the sum of squares for treatments, ignoring confounding. 
It is convenient to tabulate block totals at this time. 


Block Totals 


2964)? 
Correction faetor: CF — 57 = 162,690.66 


Total sum of squares: 
(70? + 50? +--+ 27?) — CF = 205,916 — 162,690.66 = 43,225.34 
Block (and replicate) sum of squares: 
2 4 2 ? 
(ente PR — CF = 168,822.44 — 162,690.66 = 6131.79 
9 
Treatment sum of squares, ignoring confounding: 


2 Roy 
(126? + 178° ---- 009 — CF = 181,368 — 162,690.66 = 18,677.34 
2 
Next form the 2-way tables given in Table 16.14, which are easily 
obtained from Table 16.13. 
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Taste 16.14 2-Way TABLES 


80 D 82 


' do 356 301 231| 888 
dı | 376 207 402 | 1045 
d» | 270 433 328 1031 


no ni na ; 
— 260 391 237 
449 312 284 
443 335 253 


385 299 318 | 1002 
362 406 233 | 1001 
405 333 223 | 961 


LE ees 


1152 1088 774 


These tables are used to compute sums of squares for main effects 
and 2-factor interactions. For example the sums of squares for the 
effects aud interactions D, S, DS, and DS? are obtained from the upper 
table as 
(356? + 376? +- - -+ 328?) 

6 


The first 3 entries in Table 16.15 are computed in this way. Sums of 


— CF = 168,823.33 — 162,690.66 = 6132.67 


TABLE 16.15 TREATMENT Sums or SQUARES 


oh ae geal 6,132.67 
„N. DN, 8,765.00 
8, N, SN, SN? 6,236.34 
D 838.78 
10 60.78 
1 4,177.34 
DSN? 446.34 
poA 352.34 
DSIN | partia liy confounded i m 
Treatment total 18.677 35 


squares for main effects are obtained from the marginal totals, as 
_ 888? + 1045? + 1031? 
wr r CT = 163,529.14 — 162,690.66 = 838.78 


AN EXAMPLE 


TABLE 16.16 COMPUTATION OF 3-FACTOR INTERACTIONS 
B e 


DS, 
DSo 
DS; 


DS» 
DS, 
DS, 


DS; 
DSo 
DS; 


DSN 
DSNo 
DSN, 


Dev, 
DNN, 
DS*N, 
(conf.) 


8 


82 


340 
325 
373 


DS*o 
DS’, 
DS’: 


DSN? 
DSN’; 
DSN’: 


DS 
DS*N*, 
DS N*, 


(conf.) 
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The caleulation of sums of squares for the 3-factor interactions is 
more troublesome but proceeds in an orderly fashion. The 2-way tables 
of Table 16.16 are obtained from Table 16.12. Note that, in the first 
three of the tables, the first and second rows are written beneath the 
third, in order, and the diagonal terms are summed, as indicated. In 
this manner we obtain the sum of yields of plots for which x; + 2z = 
0, 1, 2 mod 3, by summing downward toward the right, and successive 
tables yield this sum for x3 = 0, 1, and 2. Similarly, summing diago- 
nally downward to the left yields sums corresponding to 21 + x» = 
0, 1,2 mod 3. The last two tables are formed from the above sums in 
a straightforward way, and the diagonal summation process is applied. 
The object of the process is now apparent. It was desired to obtain 
sums, for example, for which 21 + 22 + 2:4 = 0, 1, 2 mod 3. The solu- 
tions, for example, to the equation x, + za + 2x4 = 1 mod 3 are those 
for which zı + z; = 0, 2x3 = 1 mod 3; zı + 22 = 1, 2:4 = 0; and 
zı + t = 2, 2x3 = 2 mod 3. 

With the results of the diagonal summation process applied to the 
last two tables, now compute sums of squares for the 3-factor interac- 
tions, still ignoring confounding. Thus, 


1029? + 1020? + 915? 
18 


The sums of squares thus obtained are entered into Table 16.14. As a 
check on the work, compute the treatment sums of squares by subtract- 
ing the sums of square for D, S, and N from the sum of the remaining 
entries in Table 16.15 which have been so far computed. This, of 
course, must check with the previous computation. 

If the interactions had been completely confounded, the preliminary 
computation would be completed, and the analysis of variance table 
could now be set up. However, in the present example, the contrasts 
are partially confounded. DS*N is confounded in the first replicate, 80 
that, to obtain the sums of squares for this interaction, we require the 
sums of yields from the second replicate corresponding to solution of 
2 + 2n + x» = i. These sums may be readily obtained by subtrac- 
ion of appropriate block totals for the first replicate from the sums 
obtained from the last of the 2-way tables of Table 16.16 (see Table 


DSN? : 


— CF = 163,137 — 162,690.66 = 446.34 


16.17). 
Taste 16.17 
DS DSN, DSN, 
— sup PARE n 
1047 1058 859 Sum of re 
ps 1 and 2 
535 680 486 Sum of rep 1 


512 378 378 
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The sums of yields in the first replicate corresponding to the solution 
of the above equations are the block totals, for this was the way in which 
the confounding was accomplished. Care must be taken, however, to 
subtract the appropriate block totals. Our notation simplifies this, for, 
in the column headed by DS?No, we need find the block containing solu- 
tions to x; + 2r» + x3; = 0; that is, we need only pick out the block 
containing the control, which is seen to be the second. In the column 
headed by DS?N;, correspondingly we need only look for the block con- 
taining the treatment d;sono, the upper block. The sum of squares for 
the interaction DS?N is then computed in the usual way as 


512? + 378? + 373? 1263? 
9 


= 60,461.88 — 59,080.33 - 1381.55 


In a similar manner, the sum of squares for DS?N? is computed (Table 
16.18). 
TABLE 16.18 
DSN  DS*N*, DSN’? 


1002 1025 937 
393 464 406 


609 561 531 


609? + 561? + 531? 1701? 
9 


The analysis of variance table may now be set forth, as in Table 
16.19, error sum of squares being obtained by subtraction. 


= 107,507 — 107,163 = 344.00 


TABLE 16.19 ANALYSIS OF VARIANCE 


Due to Sum of Squares Mean Square F 
Blocks 5 6,131.78 
.D 2 838.78 419.39 
8 2 60.78 30.39 
N 2 4,177.34 2,088.67 2.509 
DNS 4 5,233.11 1,308.28 
DXN 4 3,748.88 937.22 
SNN 4 1,998.22 499.55 
D xS x N Unconf. 4 998.68 249.67 
Partial 
conf. 4 1,725.55 431.39 
Error 22 18,312.22 832.37 
Total 53 43,225.34 
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16.5.1 Presentation of Results 

For most purposes it is best to form the 3 X 3 tables, as in Table 
16.90. These are directly computed from Table 16.14 in this case, be- 
cause 3-faetor interactions only are confounded. Standard errors are 
also included. 


TABLE 16.20 PRESENTATION OF RESULTS 


Spacing Sulphate of Ammonia 
Mean 
None 
16.43 16.49 
16.75 16.58 
16.75 16.57 


Means 16.56 16.56 16.53 16.64 


f Sulphate of Ammonia 
. 
None | O3cwt N | 0.6 ewt N 
10 in. 16.64 16.50 16.53 
15 in. 16.60 16.68 16.39 
20 in. 16.607 16.56 16.37 


Standard error of means (means of 18 plots) 
= 0.008 General mean = 16.55 
Standard error of cell figures (means of 6 plots) = 0.118 a 


i bis e also set out the results in a form such as Table 16,21, which 
15 ius y on the basis of the definitions of effects and interactions. 

8 ry be noted that, for the interactions that are confounded, the 
mean o plots for the replicates in which the, interaction is not con- 
founded is subtracted instead of the over-all mean. 

Table 16.21 may be used to construct the estimated yield of any treat- 
ment combination or the estimate of any contrast among the treatmen! 
combinations by use of the formula given earlier. 
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TaBLE 16.21 Estimates OF EFFECTS AND INTERACTIONS 


Level 
Effect or f 
Interaction Linear Quadratic 
0 1 2 

D —0.056 0.032 0.024 0.079 + 0.096 | 0.048 + 0.083 
8 0.008 0.007 | —0.015 | —0.023 + 0.096 | 0.011 + 0.083 
N 0.091 0.028 | —0.119 | —0.210 + 0.096 | 0.042 + 0.083 
DS 0.113 0.009 | —0.122 

DS? —0.021 0.029 | —0.008 

DN —0.061 0.058 0.002 

DN? —0.091 0.018 0.072 

SN —0.021 | —0.058 0.078 

SN? 0.014 0.014 | —0.028 

DSN 0.039 | —0.001 | —0.039 

DSN? 0.023 0.018 | —0.041 

DSV 0.006 | —0.143 | —0.148 

DSN? 0.047 | —0.007 | —0.041 


16.6 THE USE OF ONLY ONE REPLICATE 


Frequently, it is desired to use only one replicate of a 3° experiment. 
For example, if inferences are to be drawn about effects over a certain 
geographical area, it may be better to use as many randomly sited loca- 
tions as possible with only one replicate at each place. The best con- 
founding would be to confound one pair of the 3-factor interaction de- 
grees of freedom to give blocks of 9 plots. In this case the analysis of 
variance for each experiment could be based possibly on the assump- 
tion that interactions except linear X linear interactions between 2 fac- 
tors are negligible. This gives the breakdown shown in Table 16.22. 


Taste 16.22 


Source of Variation 
Blocks 
Main effects 
Linear X linear interaction 
between two factors 3 
Error (higher-order interaction) 15 


ens 


8 | 
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The computation proceeds in a straightforward fashion. There is no 
difficulty in obtaining the sums of squares for blocks or for the main 
effects. The linear X linear interactions of 2 factors may be obtained 
by considering the contrasts previously defined. Since the defined con- 
trasts are orthogonal, we may compute a square for each of the 3 inter- 
actions. Thus the square for Az X Br, = Molas — ao)(bs — bo) (co + 
ci + ee) l', in which the expression in the brackets is to be expanded 
algebraically and yields are to be substituted. The divisor is obtained 
in the usual manner; the expression to be squared is formed by (sum of 
yields of 6 plots — sum of yields of 6 plots), and so the divisor is 12. 
Squares for Ar X Cr and Bz X C may be similarly computed. The 
sum of squares for the remaining interactions may then be obtained by 
subtraction. 

This type of experiment should, by and large, be confined to techno- 
logical problems. The assumptions that:must be made to obtain esti- 

_ mates of error are somewhat drastic and unrealistic for most situations. 
Of course, with prior information, one may be able to make the neces- 
sary assumptions on the smallness of some high-order interactions. 


16.7 CONFOUNDING 3" EXPERIMENTS IN LATIN SQUARES 


Under some circumstances it may be desirable to impose a double re- 
striction on the pattern of a 3" experiment. Thus, there are arrangements 
for a 3* and 3* experiment in 9 X 9 squares such that only high-order 
interactions are confounded with rows and columns (Yates Cochran 
and Cox ). For the 36 experiment one may confound any one 3-factor 
interaction with rows and another with columns. For the 3* experiment, 
one may use 2 different systems of confounding that give 9 blocks of 
9 plots for rows and columns: e.g., confound ABC, AC?D, AB?D?, 


BC*D* with rows and ABC?, ACD?, AB*D, BCD with columns, as 
shown in Table 16.23. 


TABLE 16.23 


0000 0211 0122 1202 1110 1021 2101 2012 2220 
2102 2010 2221 0001 0212 0120 1200 1111 1022 
120 1112 1020 2100 2011 2222 0002 0210 0121 
0222 0100 0011 1121 1002 1210 2020 2201 2112 
2021 2202 2110 0220 0101 0012 1122 1000 1211 
1120 1001 1212 2022 290) 2111 0221 0102 0010 
0111 0022 0200 1010 1221 1102 2212 2120 2001 
2210 2121 2002 0112 0020 0201 1011 1222 1100 
1012 1220 1101 2211 2122 2000 0110 0021 0202 
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The combinations of this table are easily obtained by termwise addi- 
tion modulo 3: e.g., (0000) + (0211) = 0211, and (2102) + (0211) = 
(2010). 

Of a somewhat different nature are designs in 3 X 3 squares for 3? 
factorial systems. Thus, we may have available a number of experi- 
mental animals for 3 periods, which are the same for the animals in 
groups of 3. Under these circumstances, we may make up a design 
which has valuable properties: 


Period 


Animal 


1 00 01 02 4 00 11 22 
2 10 11 12 5 21 02 10 
3 20 21 22 6 12.20 01 


Denoting the 2 factors by a and b, in the first square, we haye A con- 
founded with animals and B with period, while AB and AB’ are un- 
confounded, In the second square, AB is confounded with periods, and 
AB? with animals. If, therefore, one can assume additivity, repetitions 
of the basic pattern of the above 2 squares give information on all effects 
and interactions, this information being obtained by comparisons within 
animals and within periods. As a field experiment, for animals we can 
read “rows” and for periods we can read "columns. 
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CHAPTER 17 


The General p' Factorial System 


171 THE REPRESENTATION OF EFFECTS AND 
INTERACTIONS 


We shall use p to denote a prime number, and the following treat- 
ment is fairly easily seen to be the straightforward generalization of the 
case p = 3, and indeed also of p = 2. In the latter case, however, the 
general system is amenable to a modification which simplified the pres- 
entation. This is easily seen by noting that there are only 2 numbers 
modulo 2, namely, 0 and 1, and the correspondence of the attributes of 
even and odd to the numbers 0 and 1 is exact and simple to understand. 

We can see the generalization from the 3" system fairly easily, with- 
out introducing proofs. These proofs are based on the properties of 
Galois fields which will be given later. The non-mathematical reader 
can easily verify that the system works in particular cases. It should 
be noted that we specified that p is a prime number and the system is 
valid only for such numbers. 

We represent the treatment combination by numbers zit *** Tn, 2; 
being the level of the ith factor in the particular combination. The 
number z; will take on values from 0 to (p — 1). All the numbers we 
deal with are reduced modulo p; i.e., if we obtain by calculation a num- 
ber greater than (p — 1) we replace it by the remainder after division by 
P. The p" — 1 degrees of freedom between the p" treatment, com- 

n 
binations may be partitioned into (z 


) sets of (p — 1) degrees of 


freedom, each set of (p — 1) degrees of freedom being given by the con- 


trasts among the p sets of p"~ treatment combinations specified by the 
following p equations: 


ir + ate db aur, = 0 


r + azta . our, = 


mod p (1) 


a7; + agro Tc ars = (p — 1) 
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The coefficients of these equations, the a;'s, must be positive whole 
numbers between 0 and (p — 1), not all equal to zero, and, for unique- 
ness of enumeration, we restrict the coefficient of the first a; that is not 
zero to be equal to unity. The sets given by the equations He = j 
mod p where j takes on necessarily the values, 0, 1, , (p — 1), and 
A is any whole number from 1 to (p — 1) will be the same sets, in differ- 
ent order, as those given by 


Lar; = k mod p (2) 
for there is a unique solution k to the equation 
M: = j mod p (3) 


and it is one of the numbers 0 £o (p — 1). Without the restriction we 
can choose each a; in p ways, giving p" possible linear functions Zajz;, 
and, excluding the case when all the a;'s are zero, and dividing by 
(p — 1), the possible number of values of N, we find that the number of 
sets of (p — 1) degrees of freedom is (b — 1)/(p — 1) Two sets of 
(p — 1) degrees of freedom resulting from equations with left-hand 
sides Zajr; and E8;z; will be orthogonal unless 8; = ka; foreach i. For 
the two equations, 

Zait; = k| oda (4) 

TB. =! J 
will be satisfied by put: treatment combinations, if 8; is not equal to a 
constant multiplier of a. The sense in which these 2 sets of (p — 1) 
degrees of freedom are orthogonal is that any comparison with, of course, 
1 degree of freedom, from the 1 set will be orthogonal to any compari- 
son from the other set. This may be examined by classifying the treat- 
ment combinations according to the scheme shown in Table 17.1. 

Let nx: be the number of treatment combinations in the (k, J) cell, 
and let the yield of each treatment combination be determined with in- 
dependent errors subject to the same variance. If we let Xo, Xy, °°"; 
X, be the total yields of treatment combinations for which Zajz; = 0, 
1, 2, „ p — 1 and, correspondingly, for Yo, Yi, Ys, ***; Yp-1, 2 
comparisons of the type in question may be represented by 


Da. X. with Za; = 0 


and 
Tb. F with Tb. =0 
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Taste 17.1 
Laz; =k 


piri = 1 


The condition for orthogonality is then 
Zajbjni -0 (5) 


and, because niz is constant (equal to p”~?), the condition is satisfied. 
Corresponding to the equations whose left-hand side is 


0321 ＋ at . ＋ an 


we use the symbol A? B= C... to denote the set of (p — 1) degrees 
of freedom restricting the power of the first letter occurring to unity. 


" 5-1 
In this way, we may enumerate, for example, the 31 (- Rol sets 


~ of 4 [= (p — 1)] degrees of freedom for the 5° system with factors a, 
b,c. They are: I 


Main effects: 
A, B, C, 

2-factor interactions: 
Of a and b: AB, AB?, AB?, AB* 
Of a and c: AC, AC?, AC?, AC* 
Of b and c: BC, BC?, BC, BC* 
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3-factor interactions: 
ABC, ABC?, ABC*, ABC* 
ABC, AB?C?, AB*C*, ABC. 
AB*C, ABC, AC, AB*C* 
AB*C, AB‘C?, ABYC’, AB*C*. 


17.2 CONFOUNDING WITH THE p” SYSTEM 


A system of notation such as the above is necessary in order to rep- 
resent all the degrees of freedom in an orderly way and to make possible 
an enumeration and choice of systems of confounding. The only di- 
visors of p" are powers less than n of p, so that we can have equal-sized 
blocks of any size p', where s is less than n. The desirability of using 
equal-sized blocks, although intuitively fairly obvious, may be explained 
in terms of error variance, because the error variance will generally be 
a function of the size of block in a particular experimental situation, 
and, since homogeneity of error is the basis of the analysis on which 
we rely for the most part, it is desirable to have blocks of equal size. 
If we knew exactly the relation between the errors with various sizes 
of blocks, we could, conceptually at least, cope with the analysis of an 
experiment with unequal-sized blocks. 

In order to devise systems of confounding in blocks of p*, we need a 
rule of the generalized interaction corresponding to the rules in the case 
of p — 2 and p — 3 which have already been given. The general rule 
of generalized interactions may be stated as follows: If effects or inter- 
actions denoted by X, Y are completely confounded with blocks, then 
so are the (p — 1) sets of (p — 1) degrees of freedom denoted by XY, 
XY?, . „ XY?7! where these symbols are to be written in terms of 
the letters ABC, etc., the pth power of any letter is to be replaced by 
unity, and the resultant symbol is to be raised to such power as makes 
the first letter in it have a power of unity. This may be proved as fol- 
lows: Let X correspond to the equations, 


deg he eats m0, m 1,777 = > 1) mod p (6) 


and Y to the equations, 


C (7) 
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Because X and Y are confounded completely with blocks, the plots of 
any one block all satisfy the equations, 


atı + d ++ ++ antn = i mod p 
Bit + Bota +++++ Bum, = j mod p 


where 7, j are each one of the numbers 0 to (p — 1). For these plots, 
the equations may be combined to give 


(e + 3M)zi + (a2 + NM) E. ＋ (an + NMB.) = i + Xj mod p (9) 


where A ean take on any value from 1 to (p — 1). The coefficients on 
the left- and right-hand sides must be reduced modulo p, and they then 
correspond to the symbol XY^ given above. "Thus, the plots of any 
block take on a constant value for any one of the equations correspond- 
ing to X V, where ) is any value from 1 to (p — 1). The effect or inter- 
action XY" is therefore confounded with blocks for these values of ^. 

The enumeration of systems of confounding is thus rendered very 
simple. The total number of systems of confounding for a p" experi- 
ment in blocks of p* is equal to 


(p" — 1)(p" — p) «+++ (p" — p^!) (10) 
( — D — p) «+++ (ph — p^) 
as may be verified by noting that the confounded effects and interactions 
are generated from a suitable choice of (n — s) effects and interactions. 
These (n — s) effects must be independent, in the sense that no one of 
them results from taking the generalized interaction of any of the others. 


£ "os 1 NL 
The first may be chosen in (E -) ways: the second in (* T ) 
* 5 
" uu "^l ^ Qn 
ways, and so on, giving 0 *) (= eng (=) as the 
p-1 p-1 p-—1 


total number of systems of confounding generated in this way. Any 


n: .. 

one system will, however, have been enumerated in (=) x 
* * — yt a1 

— i ( 33 ) different ways, so that the number of 

distinct systems is stated. 


We now give two examples. First, we consider the arrangement of 
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a factorial experiment on 2 factors each with 5 levels in blocks of 5 
plots. The number of systems of confounding is equal to 
2 
9 
(5 — 1) 

and they are the confounding of A, B, AB, AB?, AB?, and AB‘, re- 
spectively. The division of the 16 degrees of freedom for the interac- 
tion of a and b into 4 sets of 4 degrees of freedom is entirely a formal one 
and, in some senses, purely a mathematical device. If the experimenter 
is at all interested in estimating or testing for interaction, information 
must be obtained on all components. A suitable experiment might 
then consist of 4 replicates, confounding each of AB, AB?, AB’, and 
AB? in one of the 4 replicates. This design would give full information 
on main effects and 34 relative information on the interaction. Alter- 
natively, if the experimenter were equally interested in main effects and 
2-factor interactions and could afford te necessary resources, 6 repli- 
cates could be used confounding each of A, B, AB, AB?, AB, and AB*. 
in 1 replicate. 

Second, we consider the confounding for 3 factors each at 5 levels 
into blocks of 5 plots. - The number of systems is 


(5 — 1)(53 — 5) 124.120 
(5 —10 -5 24.0 
The systems of confounding are of the following types, the number of 
distinct systems of each type being given in [ ]: 
1: A, B, AB, AB?, AB, AB* [3] 
II: A, BC, with products (i = 1, 2, 3, 4) [3 X 4] 
III: AB’, BC? with products (i = 1, 2, 3, 43 = 1, 2,3, 4) [16] 


3l 


e.g.: 
A, BC, ABC?, AB'C*, A B*C, ABYC 


It is easy to see that we have a complete enumeration. The systems 
of type A, ABC! with products are contained in type I; eg, A, AB?C?, 
give as products: 
AAB?C3 = A = (A?B? C9) = ABC* 
424 B = ATB"C? = (ABC = AB'C 
AAB? = AtB? = (AS3B?C9)* = ABC? 
| AAB? = AR = pic? (BC) = BC* 
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Note that we equate a symbol in which the power of the first letter is 
not unity to the power of itself which reduces the power of the first 
letter modulo 5 to unity. 


If we wished to obtain the maximum possible accuracy on main 
effects, and were prepared to lose information to some extent on 2-fac- 
tor interactions, we could use 2 replicates with the following systems of 
confounding: : 

First replicate, confound — AB", BC*, A HC, A H, AC*, ABC? 

Second replicate, confound AB, BC, AB?C?, AB?C*, AB‘C, AC? 
This experimental design would give: 

Full information on main effects. 

Half information on AB, AB’, AC*, AC*, BC?, BC?. 

Full information on all other 2-factor interaction components. 
Zero information on AB*C. 

Half information on 4 5202, AB*C*, ABC?, AB?C*. 

Full information on all other 3-factor interaction components. 


The composition of the blocks in this design is left as an exercise to 
the reader. 


The constituents of each block may be obtained by the use of the 


‘ intrablock subgroup. Consider the block for which the following two 
equations are satisfied; 


È aizi = 0 mod p 
1 
^ (11) 
2 bizi = 0 mod p 
1 


The treatment combination (0, 0, 0, +++, 0) satisfies these equations. 


If (yi, +++, yn) and (21, 22, % Zn) satisfy the equations, then so do the 
treatment combinations, 


Ayı Tan, Na + 122, % M Uz») (12) 


where À and u may each independently take any value from 1 to 
(p — 1), and each term (Ay; + uz;) is reduced modulo p. The treat- 
ment combinations which are in this block therefore form a group, if 
(0, 0, 0, 0, + . 0) is regarded as the unit element and the law of combi- 
nation is addition of coordinates with reduction modulo p. If the treat- 
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ment combination (zi, xo, , £n) is written as a”b™ ---, the rule of 
combination is then multiplieation with the proviso that the pth power 
of any letter is to be replaced by unity. The elements of this block 
are known as the intrablock subgroup. If (xı, «++, £n) is an element of 
the intrablock subgroup and (yi, , Yn) lies in the block given by the 
equations, 


Zajr; = k mod p ! 
Ibix; = l mod p 
ete. 


then the treatment combination (x; + yi ***, Zn + Yn) lies in this 
block, for its coordinates satisfy the same equations as (yi, +++, Yn); 
and so the other blocks may be generated by addition. 

We may give as an example of confounding the use of blocks of 9 
plots for the 3* system. Suppose the confounded interactions are 
ABC, AB?D, AC?D?, and BC. The intrablock subgroup consists of 
treatment combinations satisfying 


zı + tg + z3 = 0 mod 3 
2, + 272 + z4 = O mod 3 


i.e., the treatment combinations: 


0000 1110 
0121 1201 
0212 2011 
1022 2102 

2220 


We may note that this group is generated by 0121 and 1022. For call- 
ing these z and y, we have in order 0000, z, 2, y, 1 +y, 21 ＋ y, 2y, 
x + 2y, 2r 4-2y. The whole set of 9 blocks is then as shown in 


'Table 17.2. , 
Taste 17.2 


I II III IV V VI vH VII IX 
0000 1000 2000 0100 0200 0010 0020 0001 0002 
0121 1121 2121 0221 0021 0101 0111 0122 0120 
0212 1212 2212 0012 0112 0222 0202 0210 0211 
1022 2022 0022 1122 1222 1002 1012 1020 1021 
1100 2110 0110 1210 1010 1120 1100 1111 1112 
1200 2201 0201 1001 1101 1211 1221 1202 1200 
200) 0011 1011 2101 2211 2021 2001 2012 2010 
2102 0102 1102 2202 2002 2112 2122 2100 2101 
2220 0220 1220 2020 2120 2200 2210 2221 2222 
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17.3 YIELDS OF TREATMENT COMBINATIONS IN TERMS 
OF EFFECTS AND INTERACTIONS 


It is convenient to define the main effect of factor a at level ? as the 
mean yield of treatment combinations for which æ1 = 7 minus the mean 


yield of all treatment combinations, u, say, and to denote this effect by 
the symbol A;. In the same way we denote by AM BSCS Dy, the 
mean yield of the pur treatment combinations for which D Qili = T 
mod p minus y. : 

In all, we shall have ( 


the quantity 


1 
) symbols A“ B@C™ ., and we consider 


N (13) 


" 1 
where summation takes place over the (2 -) possible choices of 


(ai, ao, +++) and f, J, k, . are fixed and the suffix a4? + aj + agk ++: 
is reduced modulo p. "The sum will contain 


/ (E — *) 
ET u 
mt 
and we proceed to collect the other terms. The treatment combination 


05 J. k, +++) occurs in each symbol with a divisor p*~', because we con- 
sider the mean of the combinations satisfying an equation, so that the 


sum contains 
1 (£ — =) 
ppi tijk- 


where tijk... is the yield of the combination (i, j, k, . . .). Now con- 
sider any other treatment combination , ). 
the symbol AR . gsi then, 


If it occurs in 


eii + a. alt + dj . mod p 
Or 


ali — 10 + alj- /) = 0 mod p 


If we regard this as an equation in (at, ao, . .), there are "^! solu- 
tions and (p"~' — 1) solutions apart from (0, 0, 0, . ., 0). There are 
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p es y Í 
Er a ) distinct solutions, because, if (a1, , an) is a solution, 
(key, «++, kan) is the same solution, where k = 2, 3, ---,(p — 1). The 
sum consists then of 


1 (==) gu n »-1 
E Vtg.. + —— (all other % .) — 
"zi poi lijk ＋ D other tijk ) L 


p 
and this equals 


1 (253 iN = 
= ben.: AL 8 (9 ge) 
FA 7 pi 2 >) 


which equals 4% . — . 
We have, therefore, the following expression for the true yield of the 
combination (it. .) in terms of the effects and interactions: namely, 


lijk = u + ym B (14) 


laran) 


= 
) possible choices of (al, a2, ***; 


where summation is over the (E 
an). For example with p = 3, n = 3, we have 
log = u + Ao + Bi + ABI + AB, + C2 + AC: + AC", 

+ BCO + BO + ABCo + ABC?, + ABC, + AB*C^, 


17.4 ANALYSIS OF p” FACTORIAL SYSTEMS 
The linear model for the p" experiment may be written as 
Vijk-- nm = u F Tn T ban F ge + ijken 


where the subscript n denotes the replicate number, 7, the contribution 
of the nth replicate, m the block within the replicate, and bam the con- 
tribution of the mth block within replicate n. 5 9 

If confounding according to any of the systems discussed in this chap- 
ter is used in making up the blocks, when 4x is replaced by its expres- 
sion in terms of effects and interactions, we shall find that any one block 
component will have the same coefficient as an effect or interaction com- 
ponent throughout a replicate in which that effect or interaction is con- 
founded. For example, suppose we have a 2? experiment on factors a 
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and b in blocks of 2, confounding A ih the first replicate and B in the 
second replicate. Then the 8 observations may be expressed as follows: 


Yoo = # + Ao + Bo + ABo + rı + bu 
u + Ao + BI ＋ AB, + ri ＋ bn 
u + A1 + Bo + AB, A ri + dis 
Ynez = u + Ai + Bı + ABo + rı + biz 
Vooz1 = # + Ao + Bo + ABo + r2 + bar 
Vioz1 = u + Ay + Bo + AB, + r2 + bza 
Voi22 = ＋ Ao + By + AB, + r2 + bog 
yuz2 = u + A; + Bi + ABo + r2 + boz 


We note that the coefficients of b,, are the same as the coefficient of Ao, 
and those of biz are the same as the coefficient of A, in the first replicate, 
and so on. 

All coefficients in the model are either zero or unity, so that the nor- 
mal equations are obtained by equating, for each parameter, the total 
of yields containing that parameter to its expectation in terms of all 
the parameters. If all the treatment combinations are represented 
equally ‘frequently in the experiment, the normal equations reduce to 
simple equations: (1) that any unconfounded effect or interaction is es- 
timated by the corresponding comparison of the actual yields over the 
whole experiment, and (2) that any confounded effect or interaction is 
estimated, likewise, from the replicates in which it is unconfounded. 


I 


70111 


71012 


17.5 THE INTERPRETATION OF EFFECTS AND 
INTERACTIONS 


pproach may be adopted for the interpretation 
p equally spaced levels of the factor, we may 
t of A, for example, as 


Du p-3 =g 
-Ja = (C=), — etc. 1 45-2 


2 
2 — 1 
T C) 2 


The usual regression a 
of main effects. With 
calculate the linear effec 


=a P(p? — 1) 9 — 


12 
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and, with r replicates and A unconfounded, the corresponding sum of 
squares is : 

(p! — 1 
* ) 


A? 
L 12rp^^! 


The quadratic effect is expressible as the following linear contrast 
among the yields at each level: É 


aE] 


1 16 
? P» - De — 4) d 
180 


and, with r replicates and A unconfounded, the corresponding sum of 
squares is 
p(p? — 1)(p" — 4) 

180rp"— 


Corresponding to these linear, quadratic, ete., effects, we may form the 
linear-by-linear interaction of 2 effects, and so on, as in the case of the 
3? experiment described in Chapter 16. 


4²⁰ X 


If the levels are not equally spaced and occur at, say, Io, lh, +++) li- 
the linear effect of A may be obtained by finding the regression of A, 
on l;: i. e., ° 

b» ( — DA; 
ALT (7) 
LG. h 
The quadratie term must be orthogonal to this and is given by 
Ag = 3 cA; (18) 


i 


where c; is equal to (a + bli + „), the coefficients a, 8, and y being 
chosen such that the Ag is a contrast which is orthogonal to the Ar 
contrast. For these conditions to hold, we must have 
2» ci 0 
; (19) 
Lei 0 = 0 


This process may be extended indefinitely. 
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17.6 THE KNUT VIK SQUARE 


The Knut Vik square is a Latin square which results.in an even dis- 
tribution of treatments over the experimental area, thus: 


ee MN SS NS 
o x OQ t ty 
iy TESI E. ue 
S 8 8 & 5 
Uo ROO h 


We have seen that, if we have 2 factors, z and y, each at 5 levels, the 
total of 24 degrees of freedom can be partitioned into 6 sets representa- 
ble by X, Y, XY, XY?, XY?, XY*. If rows and columns are regarded 
as the 2 factors with levels 0, 1, 2, . ., 4 in order, then, in the above 
square, treatments are arranged according to the partition denoted by 
XY?. The partitions XY* and XY represent another systematic ar- 
rangement in which treatments tend to lie in diagonals. The other par- 
tition XY? gives the following square: 


SUNE BC 
B EC.A D 
C TARD B -B 
DBECA 
ECADB 


which is identical with the Knut Vik square, except for inversion about 
the diagonal. The fact that there are two possible Knut Vik squares 
should not, however, lead us to Suppose that a valid design may be ob- 
tained by taking one of these at random. If we remove the sum of 
Squares represented by X, Y, XY, and XY“ for positional effects, we 
shall have a treatment sum of squares whose expectation is the same 
as that of the error mean square. With a randomization test, we would 
be able to make a significance test only with a level of significance of 
50 percent. Furthermore, there is no possibility of estimating the vari- 
ance of plot errors to which treatment comparisons are subject. 
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17.7 THE ARRANGEMENT OF n FACTORS EACH WITH 
p" LEVELS IN BLOCKS OF (?") 


The general theory on which the previous parts of this chapter are 
based is a special case of Galois field theory. A treatment of group 
theory is essential because there are (p”)" different treatment combina- 
tions which are to be arranged in equal-sized blocks in several ways. 
The (p")" treatment combinations may be regarded as the points of a 
finite geometry: that is, as the individual points of a set of points. 
Furthermore, it will be convenient if we can have a representation such 
that the points lie, in a particular sense, on lines, planes, and so on, 
so that we may take the lines (or planes, ete.) as blocks. The reader 
will, after having studied Chapter 16, see the value of such a represen- 
tation. For, in the case of a 3" experiment, we could represent the 
treatment combinations by the points of an n-dimensional lattice, such 
that each line on the lattice contained 3 points, each plane contained 
9 points, and so on. The lines, planes, or hyperplanes would then be 
used to give blocks, because they occur in sets, each one of a set con- 
taining the same number of points. We proceed to give the elementary 
notions of fields and Galois fields, and the reader should have no diffi- 
culty in seeing the value of their introduction into the discussion. 

A set of s elements uo, t1; * * *, Us—1 is said to be a finite field of order 
s, if 


1. The elements may be combined by addition with the laws, 
Ui + Uj = Uj + us u; + (uj + ux) = (ui + uj) + u 


given u; and ux there is a unique u; such that u; + uj = wr and the 


element having the additive property of zero is uo so that 
uo + uj = u, for any j 
2. The elements may be combined by multiplication with the laws, 
u, = Uji; uu = (uni u(uj + ux) = Wig + Uk 


and given any u; (7 uo) and any ur there is a unique uj such that 
u;uj = uy It is verifiable that uo has the multiplicative properties of 
zero: i.e., that ugu; = uo. The element having the multiplicative prop- 
erty of unity is chosen to be w. 


The finite field of p elements, where p is a prime number, may be 
represented by uo = 0, u = 1, u½ = 2, . -i = p , in which 
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addition and multiplication are the ordinary arithmetic operations, ex- 
cept that the resulting number is reduced modulo p. That is to say, 
the resulting number is replaced by the remainder obtained after divid- 
ing by p. For example, with p = 5, ug = 0, w = 1, w = 2, ug = 3, 
u4 = 4: ug + uy = 3 + 4 = 2 = w, and wu =2X%4=3 = uz, etc. 

In general, a Galois field of p” elements, which is a special represen- 
tation of a finite field, is obtained as follows. Let P(x) bea given poly- 
nomial in x of degree m with integral coefficients; and let F(x) be any 
polynomial in z with integral coefficients. Then F(x) may be expressed 
as 

F(x) = f(z) + p.- q(x) + P(x)Q(z) 

where 


f(x) = ao + dir + az? + +--+ d, 27! 


and the coefficients ao, a1, «++, 4, 1 belong to the set 0, 1, 2, . .. p — 1. 
This relationship may be written 


F(x) = f(x) modd p, P(z) (20) 


and we say f(x) is the residue of F(x) modulis p and P(x). The func- 
tions F(x), which satisfy this relation when f(x), p, and P(x) are kept 
fixed, form a class. If p and P(x) are kept fixed, but f(x) is varied, p" 
classes may be formed, since each coefficient in f(x) may take the values 
0,1,2,.-., p —1. It may be readily verified that the classes defined 
by the f(z)'s make up a field; for example, if P;(z) belongs to the class 
corresponding to f;(z), and F;(z) to the class corresponding to %), 
then F(x) + F(x) belongs to the class corresponding to f;(z) + f)(x). 
The other operations defined for a field are, likewise, satisfied, any func- 
tion obtained by ordinary algebraic operations being replaced by its 
residue modulis p and P(x). In order that division be unique, it is 


also necessary that p be a prime number and that P t be ex- 
pressed in the form : (z) canno ex 


P(z) = PIC) PIC + pP3(x) 


in other words, that P(x) be irreducible modulo p, where p, (x) and pa(r) 
are polynomials with integral coefficients of degree positive and less 
than the degree of p(z). 

The finite field formed by the p" classes of residues is called a Galois 
field of order p" and is denoted by GF(p"). It is proved, in Carmichael,’ 
for example, that the classes are the same, regardless of the choice of 
P(z) subject to the restrictions imposed above, and that the field GF(p") 
exists if p is a prime and m a positive integer. The classes of residues 
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can be represented by the different possible functions fir), and may 
also be denoted by uo, U1, , ui, Where s > p". 

To give an instance, we shall obtain the Galois field of 3? elements. 
We have then p = 3, m = 2, so that the possible polynomials of de- 
gree 2 (= m) are ag + ax + yx", where ao, a1, a; may take the values 
0, 1, 2. The function P(x) must be irreducible modulo 3 so that we 
may exclude cases in which ag = 0. Take then do = 1; we have as 
possible functions P(x), 1 + ax ＋ dz. If aj — 0, then we have 
(1 + a52?), and, with az = 2, we have (1 + 29), which takes the value 
0 modulo 3, when z = 1; and ean be written as (1 + )( + 2x) — 3x 
so this case is impossible, leaving 1 + . When z = 0, 1, 2, this func- 
tion takes the values 1, 2, 2 modulo 3, so that it is irreducible modulo 3. 
We take P(x), therefore, to be 1-4-2?. Now consider the possible 
f(x)’s. These are of the form bo + bz, so that we have, as the elements 
of the field, uo = 0, u = 1, uz = 2, ugs = z, Ug = 2r, ugs = 1 ＋ t, 
ug = 2 + z, w; = 1 + 2x, ug = 2 2r. There is a further theorem 
that all the elements or marks of the field except the zero element uo 
can be represented as the powers of an element, which is of special type, 
known as a primitive mark. It is readily verified that y = 1+ z is a 
primitive root. For 


y-1l-ctz 

y 1 ＋ 21 ＋ 2 A2 

y? = 2 + 22? 2 + 1 201 ＋ 220 2 1 22 
* =4 =r 2 T 1 T = 2 

y 22 ＋ 22 

y 41 2 

y 2 2＋ 41 21 2 

y-4-1 


The elements of the field are representable, therefore, by 0, 1, 
14 z (=y), 2z (=y), 1+2 (, 2 (9 yf, 2+ 2 (= y?) 
(= y), 2--z(- y). Both representations are valuable, in that the 
representation in terms of z may be used for addition, and the repre- 
gentation in terms of y for multiplication, utilizing the fact that y^" 7! 
- 1, thus, y) = y? X y? = 22 X (i + 2x) = 2: + 4 22:2 2 = y. 
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Table 17.3 contains a suitable P(x) and a primitive mark for the Galois 
fields likely to occur in experimental design. 


Tasi 17.8 Garors Ferns: P(z) AND Primitive Marks 


Primitive 
p" P(z) Mark 
2 zBr-l z 
2 z ＋ 2 ＋ 1 z 
21 1 ＋ 2 ＋1 41 ＋1 
3 12 ＋ 1 rl 
3 * ＋ 27 ＋ 1 z 
5? ** 1 1 1 ＋ 2 


The use of these fields in examining the (p”)” (= s") factorial system 
is exactly analogous to the use of 0, 1, 2, ..., p — 1 for the p" factorial 
system considered in the earlier part of this chapter. The treatment 
combinations may be denoted by (zi, zs, , £n) where each c; can 
take one of the values from 0 to s — 1. The main effect of factor 1 
will be given by the comparison of s sets of 5"^ plots, these sets being 
given by the equations: 


zı =0, Uz, = Uo 
=r = ú 
= 2, = Ug 
-8—1 = M. 1 


Main effects for the other factors are similarly defined. The interaction 
of, say, factor 1 and factor 2 has (s — 1)? degrees of freedom, and these 
may be partitioned into (s — 1) sets of (s — 1) degrees of freedom. A 
set of (s — 1) degrees of freedom is given by the comparison of s sets 
of $"—! plots, these sets being given by the s equations: 


Uz, + Nus, = Uo 
Uz, + Nus, = ú 
Uz, + Nuz, = Ug (21) 


Ux, T Nus, = 4.1 
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in which À is fixed for a set of s equations to be one of ti, us, ** *, 1, 1. 
The (s — 1)? degrees of freedom for the 3-factor interaction may be 
partitioned into (s — 1)? sets of (s — 1) degrees of freedom, each set 
being given by the equations: 


Uz, + Nu, + pue, = Uo 
Uz, + Miz, ＋ uu, = 1 


Uz, + Mur, + u, = u (22) 


Uz, + Ni, + uu, = Us—1 


in which X and y are fixed for a set of s equations each to be one of ui, 
Ug, ***, Us—t, there being (s — 1)? possibie choices of M and y. 

There is no point in continuing this description, in that it is entirely 
analogous to the case when s = p given earlier. The formulas for num- 
ber of systems of confounding can be written out by substituting s for 
8 —1 


p and soon. The ( sets of (s — 1) degrees of freedom are or- 


7 — 
thogonal, and the yields may be expressed in terms of the mean, effects, 
and interactions. The only complication is that we are working. with 
the marks of the Galois field, which are not quite so easy to manipulate 
as the numbers 0, 1, 2, ---, p — 1. 

The essential fact, that we have used in the development herein, is 
that s"^! treatment combinations (z;, «++, Zn) satisfy a relationship 


Mta, Hus, Td Antz, = U 


where X, Xo, , An are marks of the field not all zero and v is a mark 
of the field. This is simply verified by noting that, if r of the coefficients 
A; are equal to uo, then all we need to do is to solve the equation in 
(n — r) of the z;, say, 


Ng, Tu Nu rü =u 


where X,, . An—r are the Ms not equal to uo. For each solution of 
this equation we will have s” solutions to the original equation by com- 
bining with the solution any choice of ws for the other x’s. This equa- 
tion has, however, gur solutions, for we may choose 2, +++, ru 7-1 
arbitrarily, and we are left with an equation N. ru = some u, and 
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there is a solution to this equation because of the definition of a field. 
The properties of orthogonality are easily verified. 

As a short example we may consider the (2°)? system: i.e., 2 factors 
each at 4 levels. For the Galois field of 4 elements a suitable P(x) is 
2? + a+ 1, and we have up = 0,u; = 1, uz = , and us = 2° = z + 1. 
It is necessary to form the addition and multiplication tables of this 
field. They are as shown in Table 17.4. 


TABLE 17.4 
Addition Multiplication 
uo uj u$ us -|Wwe wi us us 
ug | uo wp uz us uo | uo uo uo w 
ui ug us ug ul uj uz ug 
us up ul us ug ul 
us uo us ua 


"These are obtained as follows: 
1. Addition: e.g., 
utu =0+1=1= u 
Uz + us = 2x = 0 modd 2, P(x) = uo 
Ug + ug = 1 + 2z = 1 modd 2, P(x) = u 
2. M ultiplication : 
Uo X uj = 0 = uo, uj X u; = uj 
us X uj = x? = [(a? +£ + 1) + z + 1] modd (2, P(x)] 
= x + 1 modd [2, P(z)] 
= ug 
Ug X u = 1 +2 T 22 (14 2 ＋ 270 ＋ 2 
= z modd 2, P(z)] 
= Ug 
We now obtain the sets of (s — 1) (= 3) degrees of freedom by making 


ap the partitions of the 16 combinations into 4 sets of 4 combinations 
(Table 17.5). 
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TABLE 17.5 CALCULATION OF PARTITIONING FOR EFFECTS AND INTERACTIONS 
WITH 4? System 


Effect of Effect of - Interaction 

Factor 1 Factor 2 
11 T2 Uz, Ur, Uz, T ul Uz, + uz: Uz, + u 
0 0 "uo uo uo uo uo 
0 1 uo u ur ug us 
02 uo uz ug ug ur 
0 3 uo us ug ur uz 
on ur uo ul 11 uy 
11 ui ul uo us 12 
ar] uw ug us ua up 
1 3 ui ug ua uo us 
20 ug ug u ug u 
2 0 ug uy us uo uy 
2 2 us u uo ul us 
2 3 1 us ul us uo 
3 0 us uo us ug us 
3 1 us 11 Us uy ug 
3 2 us ug ui uo 1 
3 3 ug us uo uz ur 


For example, with æ1 = 3, 42 = 2, we find, from the addition aaa 
multiplication tables: 


Uz, + ul, = Ug + Uz = us + Ug = u 
Ur, + uae, = us + u = Ug + Ua = Uo 
Uz, + Uglz, = Us + ug = Ug + U = 1 


Table 17.5 gives the partitioning of the 15 degrees of freedom for the 
4? system into 2 main effects, each with 3 degrees of freedom, and 3 
sets of 3 interaction degrees of freedom. In passing, it may be pointed 
out that the above gives the completely orthogonalized 4 X 4 Latin 
square: for let us make the following transpositions: 
in the first column: 
ug =rowl, w= row 2, ug = row 3, U3 = row 4 
in the second column: - 
w= col. 1, 1 col. 2, u: = col. 3, us = col. 4 
in the third column: u = 4, w = B, uz = C, us 
in the fourth column: uo = a, u=, W=% = à 


in the fifth column: w=1, ù = 2, w=3, w= 4 
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then the square is > 1 
Aa, By Có DBs 
Bpa A» Dy Ca 
Cys Daz AB4 Bb 
` Dê, CB, Bas Ava 
For a detailed discussion, the reader should refer to Bose ? and to Mann.? 
This exemplifies the general procedure for constructing a completely 
orthogonalized square of side p^. The letter in the (ij)th cell, where 
i, j = 0, 1, 2, . „ p" — 1, of the sth language is u; + usuj, s taking on 
the values 1, 2, «++, p^ — 1. It is easily proved that the square con- 
structed in this way has all the required properties (see Stevens *). 
The use of this system in confounding will be exemplified by the 4° 


system on factors a, b, and c. The 63 degrees of freedom may be rep- 
resented by the symbols: 4 


Main effects: A, B, C 

2-factor interactions: AB, A Be, A*, AC, AC?, AC, BC, BC?, BC? 

8-factor interactions: ABC, ABC?, ABC?, ABO, ABO, A BC, ABO, 
AB*C?, AB3C? 


Each symbol represents 3 degrees of freedom, those for AB?C? being 
given by the 4 sets of equations: 


Uz, + Unus, + u, = Uo 
Uz, F uz, + uz, = 1 
Uz, + zu, + uu, = u 
Uz, + ue, + uus, = Ug 


The rule of the generalized interaction may be obtained by noting that, 
if effects or interactions corresponding to equations with left-hand sides, 


od Utz, + Ujin, + Ukir, 


V dus, jus, + uu, 
are completely confounded with blocks, then so are the effects or inter- 
actions given by the equations with right-hand sides, 
(ui + Nu ue, + (uj + Neu,, + ete. 


where À is a mark of the field. Thus, it may be verified that, if ABC? 
and AB*C are confounded, then so are A, BC?, and AB'C?, 
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The Galois field of p” elements is principally of value in constructing 
completely orthogonalized squares, and most of the useful designs which 
involve Galois fields can be obtained directly from these squares. 


17.8 FINITE GEOMETRIES 


There is à close relationship of the material of this chapter to the sub- 
jeci of finite geometries. The reader who is interested in these per se 
is referred to Carmichael. We shall give only material on finite geome- 
tries which is strictly relevant to the design of experiments. 

A finite projective geometry is a finite set of elements or points which 
are subject to a number of postulates which are geometrical in nature: 
for example, that one and only one line contains 2 distinct points. 

The finite projective k-dimensional geometry PG(k, p") consists of 
the points 

(20, £15 ** "5 Tk) 


where zo, 21, ***, Zp are elements of GF(p"), at least one being different 
from zero, and where it is understood that the point (yo Yı; , Yk) 
is the same point as the point (zo, 21, * * *; z,) if for some element of the 
GF(p"), say, a, the relations, 


yi = ei, 120,1, % K 
hold. 

This finite projective geometry is such that its points are a represen- 
tation of the possible orthogonal sets of (p^ — 1) degrees of freedom in 
the (p")**' factorial system. For example, with k = 2, p = 3, and 
n = 1, we have denoted the effects and interactions by A, B, AB, AB’, 
C, AC, AC?, BC, BOC, ABC, ABC”, AB?C, and AB*C?. These may 
be represented as the points of PG(2, 3), namely (1, 0, 0), (0, 1, 0), 
(1, 1, 0), (1, 2, 0), (0, 0, 1), (1, 0, 1), (1, 0, 2), (0, 1, 1), (0, 1, 2), (1, 1, 1), 
(I, 1, 2), (1, 2, 1) and (I, 2, 2). It will be remembered that we ex- 
cluded symbols like A?B, which would be represented by (2, 1, 0), be- 
cause (2, 1, 0) = 2(1, 2, 0). In enumerating the effect and interaction 
symbols, we made the rule that the first non-zero exponent should be 
unity, and this is the same rule essentially as that given above for the 
exclusion of points in the finite projective geometry. 

The k-dimensional finite Euclidean geometry EG(k, p") consists of 
the points (ri, £o, , Xx), such that each zy is an element of the Galois 
field GF(p"). This geometry is the representation of treatment com- 
binations that we used for the case of k factors each at p" levels. 

We now define lines, planes, and so on in these finite geometries. 
For the finite projective geometry PG(k, p") an m flat (or m space) is 
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defined to be the points that satisfy (k — m) independent homogeneous 
linear equations, a point being a 0 flat, a line a 1 flat, and so on. A 
point denotes a particular set of p" — 1 degrees of freedom, a 1 flat 
contains the points for 2 sets of degrees of freedom and their generalized 
interaction. For example, the points corresponding to the confounding 
of AB, AC, BC?, and AB?C? in the 3° system, i.e., PG(2, 3), are (1, 1, 0), 
(1, 0, 1), (0, 1, 2) and (1, 2, 2) and the coordinates, denoted by zi, 22, za, 
satisfy the one equation 


z, + 22 + 214 = 0 mod 3 


Thus, systems of confounding for the (p")"*' factorial system in blocks 
of (p")' are given by the (k — r) flats of PG(k, p"). An enumeration 
of systems of confounding is then merely a matter of enumeration of 
m flats of the finite projective geometry. 

The number of m flats in PG(k, p") is equal to 


(8 T1 — 1)(s* X 1) E (E-m Bx: 1) 


k - 
o(k, m, s) ("+ — (* — 1) --- (s — 1) 


(24) 


where s = p”. 

Similarly, an m flat in EG(k, p") is the set of points that satisfy 
(k — m) consistent and independent linear equations. The constituent 
treatment combinations of a block in the (p")* factorial experiment in 
blocks of (p.) - plots with any of the systems of confounding dis- 
cussed in this chapter form a flat. The number of m flats in EG(k, p^) is 


0 K, m, 8) vp o(k -41,m, 8) 


since EG(k, p") is the set of points in PG(k, p”) minus the points in the 
PG(k — 1, p”) for which 2, = 0. 
Our reason for describing these finite geometries is that we shall find 


them to be of use in deriving other designs, notably incomplete block 
designs. 
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CHAPTER 18 


Other Factorial Experiments 


18.1 INTRODUCTION 


In the previous chapters we have considered the more important 
types of factorial experiment: namely, when the number of levels is the 
same prime number for all the factors. We have also considered briefly 
in the last chapter the case when the number of levels of all the factors 
is the same power of a prime. In this way we have dealt with the 2”, 
3“, 4", 5", and 7" systems, and these are the only systems with the 
same number of levels per factor that are likely to be of interest to ex- 
perimenters. In this chapter we shall discuss the following: 


1. When each factor has the same number of levels, this number be- 
ing a power of a prime, since this may be dealt with for most purposes 
in a way simpler than by recourse to Galois field theory. 

2. When the number of levels for the faetors are powers (not all the 
same) of the same prime number: e.g., a 2 X 4 X 4 experiment, that is, 
one with 1 factor at 2 levels and 2 factors at 4 levels. 

3. When the number of levels are prime numbers: eg,a2*x3' 
5 that is, one with 2 factors at 2 levels and 2 factors at 3 
levels. f 

4. When the number of levels is a product of different primes: e.g., 
a 6 experiment, that is, one with 2 factors each at 6 levels. 


We shall also deal in this chapter with experiments that are almost fac- 
torial in structure, for instance, an experiment, on quality, say, type a, 
b, or c by rates of 0, 1, 2 units of a stimulus in which certain factorial 
combinations that are formally different are, in fact, the same. 

It is not intended to give an exhaustive description of all these cases. 
On the one hand, some of them are rather difficult for the ordinary ex- 
perimenter to understand and to interpret, and experimenters do not find 
it necessary in the author's experience to have recourse to them at all 
frequently. The advantages that accrue from using the simpler types 
of experiment will become evident from the descriptions that follow. 
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The importance of using experimental designs that are fairly easily 
understood cannot be emphasized too strongly. "With the complex de- 
signs, there is considerable danger of the experimenter becoming lost 
in the intricacies of the design and analysis and losing sight of his main 
objective. 


18.0 THE NUMBER OF LEVELS BEING THE SAME PRIME 
POWER 


We have dealt with this case in the previous chapter from the point 
of view of Galois fields. The treatment given below is not quite so 
general but is simpler. A further advantage is that it enables the ex- 
amination of designs, say, for factors with 8 levels in blocks of 4 plots. 

Suppose the number of levels is k which equals p", p being a prime 
number and m being some integer greater than unity. We can set up 
a correspondence between the k levels of the 1 factor and the p" combi- 
nations of m pseudofactors each at p levels as exemplified in Table 18.1 
for the case of k = 8 = 2°. 


TABLE 18.1 


Level of Factor Levels of Pseudofactors 
(1) (3) 


NOQarwnro 
-Ororore 
-"--ooccoo!t 
Hee Re OOOO 


In the design of an experiment with 2 factors, x and y, each at 8 
levels, we replace z by a, b, c and y by d, e, f, so that we have an experi- 
ment on 6 factors each at 2 levels. The analogy is not perfect, how- 
ever, for we must remember that some components of the main effect. 
of either original factor will appear formally as 2- and 3-factor interac- 
tions: for example, the interaction ABC is a contrast among the levels 
of the z factor: namely, 

(C20 + zi + T2 — T3 + T4 — Ts — 26 + 02) 
If we wish to use blocks of 16 plots we can confound the following: 


ABD, CEF, and ABCDEF 
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and main effect comparisons are not confounded. If information were 
desired on all interaction components, and it would generallly be advis- 
able in such a case as the one under discussion, 2 replicates with different 
confounding would be used. The system of confounding for 6 factors 
in blocks of 8 (Chapter 14) may be used to give a design in blocks of 8. 
The composition of the blocks is easily obtained in the usual way. 

The most frequently used design of this type is that for 2 factors each 
at 4 levels in blocks of 4 plots. Let the factors be a and b. The 3 de- 
grees of freedom for each main effect may be represented by 


„ 
A” = a3 — m di + ao (1) 

A"' = ay — a + a, — ao 
by setting do = (1), a, — z, a= y, ag = zy, so that 2X = A”, 
2Y = A’, 2XY = A". The representation we use here has a little in- 
terest, from the point of view of the linear, quadratie, and cubic effect 
of the factor. Supposing the levels to be equally spaced, then the linear 


quadratic and cubic comparisons, Az, Ag, and Ac, respectively, are, 
apart from constant divisors, as follows: 


A, = 840 — a, + a; + 3as 
Ag = m — a; — a) + ag (2) 
Ac = —a + 3a; — 3a; + 43 
Therefore, A" measures the quadratic effect, and 
A, = 2A’+ 4“ 


Ac = —A! +2A" 
or A (3) 
5A’ = 2A; = Ac 
54“ = Ar + 240 
With similar expressions for the b factor, a design in blocks of 8 is given 
by confounding any one interaction degree of freedom, say, A" H“, 
and, to obtain the blocks, we need merely to expand the expression 
4% % = (ay — a, + a — ao) (bs — by +b; — bo) 
and place combinations with a positive sign in one block and those with 
a negative sign in the other block. 
Two replicates with such differing systems would yield full informa- 


tion on main effects and on 7 of the 9 interaction degrees of freedom, 
with half information on the other 2 interaction degrees of freedom. 
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With 3 replicates a balanced design in blocks of 4 plots exists (Table 


18.2). 
TABLE 18.2 


Replicate Confounding 
A'B’, A" B". AmB 
A'B", A'B", 48 
A'B"", A"B', A'"B" 


oye 


The first replicate may be constructed by expanding the expressions, . 
A'B' = (as + d — à — ao) (bs + bz — bi bo) 
A"B' = (ag — a2 — di + ao) (ba — bz — bi + bo) 

and taking as the first block those combinations that are positive in . 


both expressions, as the second block those positive in A'B’ and nega- 
tive in A"B", etc. This gives the following blocks: 


aobo | ao: | aobs | ab: 
abı aibo abe aibs 
agb; | abs | abı azbo 
ay» | as» | aso | debi 


The other replicates are similarly constructed. It should be noted that 
this design may be derived from the completely orthogonalized 4 X 4 


square (cf. Chapter 17). 

With 3 factors each at 4 levels and 64 treatment combinations in all, 
the following system of confounding in blocks of 8 plots confounds three 
2-factor interaction degrees of freedom: , 


ae, Ar BG At B'O” 
"AB. AO BON, ARN 
For the derivation of this and other systems of confounding, one may 


note that 
A'A" = A” 


Ata”! = A’ 


and 
A tame = A" 


With a second replicate with the following confounding, 
WEC? e, 4% B"C' 
A'"' prit. AUG". AB, B'c" 
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the experiment would yield full information on main effects, on 21 of 
the 27 two-factor interaction degrees of freedom, and on 19 of the 27 
three-factor interaction degrees of freedom, with half information on 
all other contrasts. 

The derivation of other designs in blocks of 4 plots and the analysis 
of all these designs are left as an exercise to the reader. A simple way 
of analysis, though possibly tedious in some cases, is to utilize the pseudo- 
factors in the analysis also. This method of analysis is quite suitable 
to routine calculations and keeps to the front the different degrees of 
freedom which may have been confounded. -The addition-subtraction 
process may be applied to the total yields and then adjustments, ob- 
tained from block totals, applied to the partially confounded inter- 
actions. 


18.3 NUMBER OF LEVELS EQUAL TO DIFFERENT POWERS 
OF SAME PRIME 


This case follows easily by the same methods as the previous one. 
As an example, we can consider a design for 3 factors, a at 2 levels, b 
and c at 4 levels each. 'This may be represented as an experiment on 
five 2-level factors, a, by, bs, oi, ea, and it is easily seen that, with blocks 
of 16 plots, only a 3-factor interaction degree of freedom need be con- 
founded. With blocks of 8, it is necessary to confound 1 degree of 
freedom of an interaction of 2 factors: for example, we may confound 


AB'C', ABC Brg” 


As a second example, we consider a 2? X 4? experiment. We repre- 
sent the factors by a, b, ci, ca, di, dz, and to obtain blocks of 8 we must 
confound 7 degrees of freedom with blocks. A possibility would be to 
confound two 2-factor interaction contrasts and other interactions in each 
replicate, thus: AC'D", BC"D'", ABC"D', AC"D', C""D'", ABD" 

i 4, , , , 
BC'. With blocks of 16 plots, there is no particular difficulty, as we 
may confound, for example, 


AC'D", BC" p'", ABC'"D' 
184 NUMBER OF LEVELS EQUAL TO DIFFERENT PRIME 
NUMBERS 


Insofar as general rules may be obtained for this case, we may sup- 
pose we have a p"q" experiment, that is, one involving m factors each 
at p levels and n factors each at q levels, both p and q being prime num- 
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bers. We may denote a treatment combination by (T, zo, , Zw, 
Yi, Yor * Yn) When 2}, *. ::, Tm may take on the values 0, 1, 2, +++, 
p — 1 and yi, ys, ***, y» may take on the values 0, 1, 2, . . ., g — 1. 
Main effects and interactions within either of the 2 groups of factors 
may be defined as in the pure system. The difficulties with this mixed 
system arise when we consider interactions of factors in the first group 
with faetors in the second group. The (p — 1)(g — 1) degrees of free- 
dom for the interaction XY are the (p — 1)(q — 1) degrees of freedom 
for interaction in the p X q table (Table 18.3). 


TABLE 18.3 
Ti 
yi 
0 1 2 p-1 

RA 
1 
2 
9 1 


These degrees of freedom arise only by comparisons among pa sets of 
p”—'q"— treatment combinations. Therefore, if the interaction of a 
factor of the first group and a factor of the second group is confounded, 
using equal-sized blocks, the main effects of these factors must also be 
confounded. In general, if r independent effects and interactions of the 
first group and s independent effects or interactions of the second g group 
are completely confounded with blocks, the block size must be p ne. 
The possibilities of confounding the higher-order interactions only are, 


therefore, somewhat limited. : , 
As an example, we may consider the 2? X 3” experiment, and we de- 


note the factors by a, b, €, and d in order. The possible block sizes are 
the factors of 36: that is, 6, 9,12, i8. We consider, for the moment 
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only, complete confounding with blocks. With blocks of 6 plots we 
may confound any one of A, B, or AB and any one of C, D, CD, or QIP; 
and, of course, their interaction in one replicate. With blocks of 9 A, 
B, or AB must be confounded, because 9 is not an even number. With 
a block size of 12, we may confound CD or CD?, and, with a block size 
of 18, we may confound AB. 

Since most experiments are on a few factors, say, 5 or less, the above 
considerations result in the necessity of considering partial confounding. 
The type of partial confounding we shall consider is not quite of the 
same type as in previous chapters, because, in the designs discussed 
therein, an effect was either completely confounded or unconfounded 
with blocks in any one replicate. We shall consider designs in which 
effects or interactions are correlated as little as possible with block effects. 
The general methods by which the device of partial confounding is used 
are illustrated in the examples that follow. 


18.4.1 The 3 X 2 X 2 Experiment 

Let the factors be a, b, and c with 3, 2, and 2 levels, respectively. 
Frequentiy there will be no experimental difficulties in using blocks of 
12 units, and the consequent ease of analysis because of the absence of 
confounding will often offset the loss of precision resulting from blocks 
of this size compared to those of small sizes. In other cases, it will be 
important to use smaller blocks. The use of blocks of 6 plots confound- 
ing the main effect, B, the main effect C, or the interaction BC presents 
no difficulty, but these designs are more properly classified as split-plot 
designs, which will be discussed in Chapter 19. Similar remarks hold 
for the use of blocks of 4 plots confounding A. In order that main 
effects be unconfounded, the block size must be 6. 

The design for blocks of 6 plots given by Yates? is the only one that 
does not result in the confounding of main effects. To obtain this de- 
sign, we note that interaction BC is given by the comparison 


2 (by — bo) (er — co) 
i.e., 


bıcı + boco em bico — boc 


Let us denote by o the pair of treatment combinations bıcı and doco 
and by £ the pair bico and boci. Because the interaction BC is esti- 
mated by comparison among the 4 possible combinations on factors b 
and c, this interaction comparison must be partially confounded with 
blocks of 6. The BC interaction is, in fact, the comparison of a with 
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8, so that we are led to the design in Table 18.4, the first symbol of a 
treatment combination denoting the level of the factor a. 


TABLE 18.4 


Replicate 


Each block contains the levels of each factor equally frequently for 
each factor separately, but the 2 groups of treatment combinations « 
and 8 must be distributed unequally. The 3 replicates give a design 
which appears balanced in that main effects are unconfounded. The 
degree of confounding that actually results from this design will be 
shown by the corresponding analysis, which will be worked out from the 
basic mathematical model. 

Consider the true yields of each treatment combination which we may 
denote by (ijk), the levels of the 3 factors. We define 


a7 ds x (ijk) 

a; =i Dw =H 

bj = EX (ik) ~ a 

e = — (ijk) — n 
(b = 3 (ik) — as = by = n 
(ac) u = à S — 4. — e 4 
(be)jx = $ x (ijk) — b, — e = 1 


(abc) = (ijk) — a; — bj — (ab) — ex — (ae) — (bj. — u 
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In the present case, we may reduce the number of parameters: 
bo +6; — 0 so we put bo = +b, =b 
Cote, = O so we put —co = tec 
L (ab), =0 so we put — (ab) o = (ab) = (ab); 
j 


DX (@)ix =0 so we put -—(ac); = (an = (ac); 
7 
D boa = 3.004 = 0 


so we put (bc)oo = —(be)or = (be) io = (bc) = (bc) 
DX (abo); = T (abe) ijn = X (abe) ij, = 0- 
i j 


so we put (abe) too = (abe) on = (abe) no = (abe) u = (abo); 
We note also that 


Dar- o, T (ab), = o, E (ach. = 0, E (abe); = 0 


The plan in full is as shown in Table 18.5. 


Taste 18.5 
Replicate 1 Replicate 2 Replicate 3 
Block 1 Block 2 Block 1 Block 2 Block 1 Block 2 
000 001 001 000 001 000 
011 010 010 011 010 011 
101 100 ^ 100 101 101 100 
110 111 111 110 110 111 
201 200 201 200 200 201 
210 211 210 211 211 210 


We denote the actual yields by V where i, J, k are the levels of the 
3 factors, | (= 1, 2, 3) is the replicate number and m (= 1, 2) is the block 
number. The mathematical model with additivity of treatment effects is 


atis = u + ai + bj + (ab); + e + (ac) + (be) + (abc); 


+ ti +4 —1)"91 + ehe (4) 
where r; is the effect of the Ith replicate, gt is the effect of block within 
the replicate (positive for block 2 and negative for block 1), and the 
Cijkim’s may be regarded as uncorrelated and distributed with mean 
zero and the same variance 62. Clearly not all possible combinations 
of subscripts occur. The estimates of the parameters are obtained by 


minimizing 
ar ijkim 
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The first term of this sum of squares of deviations, if unnecessary sub- 
scripts are eliminated, is 


[yooo11 — u — ao + b + (ab)o + c + (ac)o — (be) — (abe)o — ri + gil? 


The resulting equations, imposing the condition Zr, = 0, are of a 
simple form, obtained by equating contrasts of yields with their expec- 
tations (Table 18.6). 


TABLE 18.6 
Equation 
lor LHS RHS 
n 36u -T 
Gi 12u + 12a; = [A]; 
b 36b = [B] 
(ab); 12b + 12(ab)¢ = [AB] 
c 36c = [C] 
(ae); 12c + 12(ac)i EIE = [AC] 
(b)  36(0c + 461 4m + 4n Y. — Yr — Y ae Yat = [BC] 
(abe)o — 12(abc)e + 12(bc) — 4gi + 462 4e Yoo-. + Yon: — Yon: — Yow» = [ABCh 
(abe), — 12(abc) + 12(bc) + 4p — 482 + 483 Yio- + VII.. Yir: — Yno = [ABC] 
(abe): — 12(abc)s + 12(bc) + 461 + 4g — 483 Yoo: + Your — Yon — Yno- = (ABC 
ri 12 + 12r, . = (Rh 
41 125 + 4(be) — 4(abc)o + 4(abc)i + Abe): T. — FT. = [Gh 
e 1262 + 4(be) + 4(abc)o — Aab) + Abe): Y... — Y--n = [Gl 
g3 12g3 + 4(bc) + 4(abc)o + 4(abc)ı — 4(abc)z Y... — F. 51 = [Gl 


These equations may be written down very simply by noting that all 
the coefficients in the model are plus or minus unity, so that the equa- 
tions are of the form, " 


Total of yields that contain a parameter positively — 
total of yields that contain a parameter negatively = its expectation 


The solutions of the equations are: 


T 
5 7 36 
12á; 2 [A]; F 
365 = [B] 
12(ab); = [AB]; — AU 
366 = [C] (5) 


12(ac); = [AC]; — MC] 

32(be) = [BC] — ${{Gh + 1G] + Le 
32(b2) + 20(abc)o = 3[ABC]s + IG]; — (G]a — (Gls 
32(5c) + 20(abe), = 3[ABC], — [Gh + [G2 — (Gls 
32(6c) + 20(abe)y = 3[ABCla,— (Gh — [Gl + [Gls 
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We note that 5, &, (bc), (ab);, (ac), and (abc); are expressed on the basis 
of the difference of half-plot yields. On a plot-yield basis, these effects 
and interactions would take twice the value indicated by the equa- 
tions. 

We see, from the form of the normal equations, that the interactions 
BC and ABC are partially confounded with blocks, so that we will have 
to obtain a sum of squares for blocks and a sum of squares for treat- 
ments eliminating blocks. The total sum of squares removed by fitting 
all the constants is equal to 


AT + Dafa}: + LB] + Z(ab) E. + eC] + T (ac) AAC]; 


+ (be)[BC] + X (abe) 4A BC]; + 0, + DAR]: (6) 


which equals 
5 EG RP, [1 E a4 E 
* Nl Fs -Zl * a 6 56 
i ee (KCI ICP) 
i (a Eum. 36 BP) + 36] ^ lg E 14€ - 36 


+ (be)[BC] + È (abc) (A BC]; + Dodo. (7) 


Apart from the last 3 terms in this sum, the terms are the quantities 
one would ordinarily calculate for the correction sum of squares, sum of 
squares for replicates, A, B, AB, C, and AC, respectively. The last three 
terms can be manipulated to a simpler form, thus: 


27 046]; + (be)[BC] + T (abe) (A BC]; 


= lG iG]. — 4(6c) + 4(abe) — 4(abe), — 4(abe) 2} 
+ ICH — 4(6c) — 4(abc)o + 4(ab2), — 4(abc)a] 
+ lll — 4(6c) — 4(abc)o — 4(abe) + 4(abc)a] 
+ (be)[BC] + Y (abe) 4A BC]; 
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= de {IGP + [G2 + (G5) 
+ (6c) ((BC] — oh — lach — Ach 
+ (abc)o([ABC]o + 3G] — Aale — Ale 
+ (abc) {[ABCh, — SIG + Ace — lch 
+ (de) ([ABC]; lol — 31Glz + 3161] 
= 3h (IGPs + [Go + (G5) + 32050)? 
+ (abc) -3(32(5c) + 20(abe)o] + (abc), : Jaa (be) + 20(abc)1] 
+ (abc) M32(bc) + 20(abe)) —— 
= 3 ICE. + 3260)? + % T (abo)*; (8) 
The first term is the sum of squares for blocks ignoring treatments, the 
second the sum of squares for BC eliminating blocks, and the third the 


sum of squares for ABC eliminating blocks. The sum of squares for 
BC can, of course, be written in the form 


32 [BC] — 3G) — 3102 — SIG? (9) 


with a similar expression for the sum of squares for ABC. The analysis 
of variance takes then the form given in Table 18.7. 


TABLE 18.7 ANALYSIS OF VARIANCE FOR 3 X 2° EXPERIMENT 


Due to df Sum of Squares 
Replicates 2 As usual 
Blocks 3 As usual 
A 2 As usual 
B 1 As usual 
AB 2 As usual 
0 1 As usual 
AC 2 As usual 
BC 1 32(bc)* 
ABC 2 22 L (abo)*; 
7 
Error 19 By subtraction 
Total 35 Sum of squares about mean 


Finally, we may examine the variance of the partially confounded 
interactions, that of the unconfounded effects and interactions being the 


usual one. The estimate (be) of the interaction (bc) may be expanded 
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as a linear function of the yields, and the variance of this linear function 


obtained. Consider 96(bc) which equals 3[BC] — [G] — Lz — [G]s. 
The coefficients of the plot yields in this linear function are as shown 
in Table 18.8. 


TABLE 18.8 
Replicate 1 Replicate 2 Replicate 3 
Block 1 Block 2 Block 1 Block 2 Block 1 Block 2 
4 -4 -2 2 —2 2 
4 -4 —2 2 -2 2 
-2 2 4 —4 -2 2 
-2 2 4 —4 —2 2 
—2 2 -2 2 4 -4 
-2 2 -2 2 4 —4 


The sum of squares of these coefficients is (12 X 4? + 24 x 2”) = 
288, and so the variance of (bc) is (1/96”)2880” = 07/32. If we require 
the interaction BC to be on a per plot basis, we use 2(bc) which has a 
variance of o”/8. This variance may be compared with the variance 
if no confounding were used, namely, o”/9, and it is seen that the par- 
tial confounding has resulted in a loss of 1j information on BC. We 
ean see that the variance we have obtained for (bc) is correct by noting 
that, for example, ~ 

(be) = (bc) + error 
and ^r 
E32(bc)* = 32E (error)? + 32(bc)? = o? + 32(bc)? 
2 
E (error)? — £i 
32 


so that 


Now, considering the ABC interaction, we note that 
~ — — 
(abc) + (abc), + (abc) = 0 


so that (abe)o, (abc);, and (abc), are correlated. The variance of any 
linear contrast 


Ro(abeo + M (abe)ı + Aa(abe)a, Xo + M + Az = 0 
is easily found by noting that 
20[Ao(abe)o + M (abe) + da(abe)s} 
BAo[ABC]o + 3[ABC]; + SN CE + Ao — M — MCh 
+ (~ro + — MIGls + (-N — M + l 
3o[A BC]o + 3S[A BC]; + 3A BC]; + 29[G]; + 2G]; + MaG] 


THE 3 X3 X2 EXPERIMENT 355 


When this is expressed in terms of the plot yields, and the expectation 
of the square is calculated, we obtain as the variance of Jo (abc)o + 
Mi (abc); + abe) 2 the quantity 


: 60 30” 
p (10822; + 962AAj)e? = (ZA*,) a = (2a*,) 1 7 


It should be remembered that the (abc) 's are correlated, and we can 
verify that 
var (abe); = — 
(abc); 10 
and R (10) 


cov (be) , (e,! = — 2 


We are, for most purposes, interested only in comparisons of the (abe),’s, 
and, for such purposes, we may, as à trick, say that the variance of each 


(abc); is 3490”, and we shall obtain the correct answer. On a per plot 
basis we estimate the ABC interaction by 2(abc);, which has a variance 
of 3802. It is easily verified that, in the absence of confounding, the 


corresponding variance would be g?/12, so that the relative information 
on this interaction is 
w/s 7 $ 


and the relative loss in information is 49. There is a curious property of 
designs, which is exemplified by this case, that the total relative loss in 
information is equal to the number of degrees of freedom confounded 


per replicate; thus, 
1x442x$71 


18.4.2 The3 x 3 X 2 Experiment 

Denoting the factors by a, b, and c, respectively, a design which gives 
full information on main effects in blocks of 6 plots is given in Table 
18.9, where AB; is the set of combinations of a and b, for which zı + * 


= i mod 3. z 


TamLE 18.9 Desiran ror 3 X 3 X 2 ExrERIMENT IN Blocks or 6 Pots 


Level of 
Third Factor 1. ly I. Ils nn Il, 
ĉo A Bi A By A Bo A Bs A Bs AB, 


[7] ABs ABy AB, AB, 42 ABa 
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By examination of the least squares equations obtained from a model 
with mean, block, treatment, and error terms, or by visual inspection, 
it is seen that the design gives 34 information on AB; 4 information on 
the interaction of AB and C, denoted by ABC; and full information on 
all other effects and interactions. If a second pair of replicates based 
on A B? is added, the information on all components of the interaction 
of a and b is 


l= 301+ 5l 
and of the interaction of a, b, and c is 
$= 201+ DI 


A reparametrization based on the 3? system leads to a simplification of 
the derivation of the analysis. 
For the case of the first 2 replicates, and using the notation, 


[Ia] = total of block Ia, ete. 
[AB,] = total of treatments for which 2, + z; = i mod 3 
[ABC]; = total of treatment combinations for which x, + z; = i mod 3 
and for which factor c takes the level 1 minus those for which 
T, + r = i mod 3 and c takes level 0 
it is found (cf. Yates ') that, with 
2Qo = 2[ABo] — [Ix] — [Ie] — [Io] — [IIe] (11) 
and similar expressions for 2Q;, 2Qo, the estimate of AB is equal to 
Tg (200, 201, 202) (12) 


each component being subject to a variance of 99 for comparisons with 
each other, and the sum of squares for AB is 


slal(2Q)* + (201)? + (2Q2)?] (13) 


Similarly, with 
2Ro = 2[ABCo] — [D] + [I.] + [II] III. (14) 


and similar expressions for 2R; and 2Re, the estimate of (ABCo, ABC,, 
ABC.) is 


J RO — 2R, 2R, — 2R, 2R, — 2R) (15) 


— > o 
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and the sum of squares for the 2 degrees of freedom is 


35 D GR, - 2R) (16) 


With the 4 replicates confounding AB and AB? equally, the expressions 
remain the same, except that there are analogous expressions for AB? 
and AB?C, the expressions A Bol, [ABC], etc., are calculated over the 
whole experiment, and that the divisor for the expressions 2Q is 42; for 
z(2Q — 20} it is 84; for the expressions 2R it is 30; and for 202 
— 2R)? it is 60. 


18.4.3 The3 x 3 X 3 X 2 Experiment 

Let the faetors be denoted by a, b, c, and d. If we consider the first 
group of factors a, b, and c, the systems of confounding in blocks of 3 
plots which do not result in confounding of main effects are as follows: 


AB, AC; AFC, BC? 
AB, AC?, AB?C, BC 
AB?, AC, ABC?, BC 
AB?, 402, ABC, Bc? 


Taking one of these systems of confounding, we may attach the sets of 
3 treatment combinations it gives to the levels of d, in such a way as to 
give blocks of 6 plots in which all the main effects are unconfounded, 
and the particular 3-factor interaction of a, b, and c is completely con- 
founded. For the first system this leads to the 9 blocks in Table 18.10. 


Taste 18.10 


I II III IV V VI VII VII IX 


000 012 021 002 011 020 001 022 010 
doj 122 101 110 121 100 112 120 111 102 
211 220 202 210 222 201 212 200 221 


012 021 000 011 020 002 022 010 001 
dı 1101 110 122 100 112 121 111 102 120 
220 202 211 222 201 210 200 221 212 


The other 3 designs may be obtained in order by interchanging 1 and 
2 for the levels of a, of b, and of c, respectively, as may be seen from 
examining the equations that define the symbols AB, AC, ete. 
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This design may be analyzed in the same way as the 3 X 2? design. 
With the above replicate, it will be found that the relative information 
on the effects and interactions is as given in Table 18.11. 


TABLE 18.11 RELATIVE INFORMATION 


A, B, C, D 1 
AB, AC, BC* 34 
ABD, ACD, BC*D M 
AB?, AC?, BC? 1 
42, AC*D, BC?D 1 
ABC? 0 
ABC?, AB?C, ABC H 
AB'C*D 1 
ABC*D, AB'CD, ABCD 1 


It is left as an exercise to the reader to derive the estimates and the 
analysis of variance by the methods given in section 18.6. 


18.5 NUMBER OF LEVELS A PRODUCT OF DIFFERENT 
PRIMES 


This case is somewhat intricate, because the main effects and inter- 
actions cannot be broken down into orthogonal contrasts as in the case 
of a prime number of levels. To take an example, if the number of 
levels is 6, we strike difficulties because there do not exist 2 mutually 
orthogonal Latin squares of side 6, so that we cannot obtain 2 systems of 
confounding, apart from the confounding of main effects, for two 6-level 
factors in blocks of 6 which result in different confounding. If we choose 
the letters of one square for the confounding in one replicate and of an- 
other square for the confounding in the second replicate, the degrees of 
freedom completely confounded in the first square will be partially con- 
founded in the second square. This may be easily verified. It is left 
as a somewhat awkward exercise to the reader to examine the analysis 
of such an experiment. It is sufficient here to state that the experimenter 
is usually not in the position of having to use a definite number of levels 
such as 6, but can take his choice among 5 or 7 levels, for which cases 
simple systems of confounding exist. 

A formal way out of the difficulty in the case of 6 levels is to regard 
each factor as arising from 2 pseudofactors, one with 2 levels and one 
with 3 levels. In this way, some of the designs of the previous class may 
be used. In the case of a 6 X 9 experiment, if the need for such should 
arise, we could regard the experiment as a 3° x 2 experiment formally, 
with modifications in the design and analysis. 
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18.0 THE GENERAL METHOD OF ANALYZING PARTIALLY 
CONFOUNDED DESIGNS 


We have given a complete derivation of the analysis for the3 X 2 X 2 
design and sketched the results for the other designs discussed. The 
analysis for the 3 X 2 X 2 design was given because it is illustrative of 
a process that is sometimes valuable, particularly when there are missing 
data. 

We can, however, utilize the formulation of Chapter 6 for the whole 
problem, and this leads to rules by which the estimates of effects and 
interactions can be written down merely by looking at the design. To 
obtain these rules we use, as in that chapter, a model containing i, the 
constant contribution, be the contribution of block i, the blocks being 
numbered from 1 to the total number of blocks in the experiment, tj, 
the treatment contribution, where j runs from 1 to the total number of 
treatment combinations = ¢, say, and an error. We obtained the 


equations, 


2 In: 
(-T) (CN) =o 1212 % (7 


* 1 i it 


where 


that is, the actual total for the treatment adjusted by the block means 
for the block effects that that total contains. For the designs we dis- 
cuss in this chapter, and assuming no missing data, we always have 
Vi equal to k the size of the block, N.; equal to r the number of repli- 
cates, and nj equal to unity if treatment j occurs in block i, and other- 
wise equal to zero. The equations reduce, therefore, to 


0 — 3 65 — : (sum of “s that occur in a block with 4j) = Q; (18) 


We know also that the best linear unbiased estimate of a linear function 
of the //s is the same linear function of the best linear unbiased estimates 
of the ¢’s. 

*onsider now a function of the /'s such as the expansion of (ABy — 
AB;)(co + ci) in terms of treatment combinations for the 3 X 3 X 2 
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design given above. The quantity Q for this treatment comparison is 
given in the table below, the coefficients of plot yields only being given: 


L I I. 


a—9 274 |i E3 


(-1+4 | (-» 


a | (+4) a-5|-i-a-p|-a-5b|-4à 1-471 
IL it, 
H = 
-i 1 


This linear function of the yields is then equated to its expectation, 
which is 


— $(ABi)e + (ABI en — 3(ABy)os + 3(4Bo)cı 
+ (ABo)co — (ABi)ei + }(4B2)co = 4(AB,)ey 


+ 3(ABo)eo — 1(ABs)e — (ABi)es + (A Boer 
which equals 


$((A Bo) co + (ABo)e — (ABI C — (AB)e] 


The expectation of.the expression reduces to a multiple of the com- 
parison we wish to estimate, because we are working with groups of 3 
plots, each group containing the levels of a, and b and, in a sense AB?, 
equally frequently. The expression which estimates 16(ABy — AB) 
X (co + ci) is then 14(Qo — Qi), where Qo, Qı are defined as before. 
To obtain the variance of this estimate, we note that the true treat- 
ment comparison is a linear function of the true treatment effects, say, 
m + N72 ＋ + Ts, and that it is estimated by 91 n + 92015 T 
n where Q, is the Q expression for treatment 1, and so on. 
From the results of Chapter 6 the variance of the estimate is (Np + 
apo E. Nies. The variance of 16000 — Qi) is therefore 260°. 
The sum of squares for this comparison will therefore be 94 X 1/9000 
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— Qı)? = Ks(Qo - QU. Ina similar way we would find that }42(A Bo 
+ AB, - 2AB2)(co + ei) is estimated by }4(Qo + Qi — 2Q2), and that 
the variance of this comparison is $40”, so that the sum of squares is 
(Qo + Qi — 2Q2)? 
9x6 
The total sum of squares for the AB interaction is, therefore, 


HQ. — Q* + Qi - Q* + Q - Q1 


For purposes of comparison of the Os we may regard the Q;'s as each 
having a variance of 1g” and zero correlation. The factor 1$ is also 
the multiplier of the particular Q function, which is used to estimate the 
corresponding parameters. This illustrates a general rule of the rela- 
tion among the variance of the Ob's, the divisor in the sum of squares, 
and the relative information. 

For the general case, suppose that we wish to estimate 


t 
XN (19) 
1 
where 
Di = 0 


the A/s are all O, +1, or —1 and the 7; is the effect of the ith treatment 
combination. As an estimate of this quantity, we shall use 


(Ze) (20) 


where Q; is the Q for the ith treatment combination and K is some 
constant. Then the variance of the estimate is (1/K) (2A?,)o”, and the 
sum of squares is 154 * Tabs 2 
LE po) 
KE K N 
L*. 


1 


Tf there were no confounding, the quantities Q; would be the total yields 
of the ith treatment combination, and k would equal 1/r the number of 
replicates, and the variance of the estimate would be 


En)" 


The relative information on the comparison is equal to 
— without ote) 
. ᷣ eee 
variance with confounding 
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assuming c? to be the same in both cases. This is equal to K/r, and, 
if we denote it by I, we have the relations given in Table 18.12. 


TABLE 18.12 
No 
Confounding Confounding 
Divisor for ZA;Q; r KerxI 
Da’; =n; Dn; 1 
Variance/c? — — =— X- 
r K r I 
Divisor of (ZA,Q)* 
for sum of squares rÆ) K CN = rx) X I 


Actually, the divisor for ZX,Q; necessary to express the comparison 
on the basis of the difference of a plot yield positive for the comparison 
n 7 
a| KI N. 
in the two cases. This rule is not followed strictly in some publications, 
but the reader should have no difficulty in reconciling the statements 
given here with others if this is taken into account. 

As an example of the utilization of this procedure, we shall consider 
the estimation of the ABC interaction for the 3 X 3 X 2 design. The 
interaction, which we may denote by AB*C, is unconfounded. We con- 
fine ourselves to 1 degree of freedom of the partially confounded inter- 
action: namely, the expansion in terms of treatment combinations of 


(ABo — ABU — ei) 


The expression in the Q's is represented diagrammatieally in Table 18.13. 


and of a plot yield negative for the comparison is 


TABLE 18.13 
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The expectation of the whole expression is readily seen to be 
l(ABoco — ABoci — ABico + ABiei) 


The divisor on this expression is therefore 14, and, with no confounding, 
we would have used a divisor of 12, so that we have 4 relative informa- 
tion on the comparison. The variance of the comparison would have 
been 160, so that, with confounding, it is 2407, and the sum of squares 
for the comparison is (Expression) 2/6. From the point of view of com- 
putation, we note that we may calculate 2o, 2R,, and 28; as given 
earlier, the expression above being equal to (Ro — R,). The sum of 
squares for the 1 degree of freedom comparison is }¢(Ro — R,)?, so that 
by symmetry the sum of squares for the 2 degrees of freedom for ABC is 


42(R; — Ry = 22K. — 2R)? 


18.7 OTHER MIXED FACTORIAL DESIGNS 


A general procedure for obtaining designs of the mixed factorial type, 
that is, of type Peg, has been exemplified in the foregoing examples. 
The guiding principle is to consider the two component pure systems 
and confounding with as low block size with each of these. For the 8 
factorial experiment, we examine therefore the 3? system in blocks of 3, 
and the 2? system in blocks of 2. If we denote the factors in order by 
a, b, c, d, we can make up blocks of 3 on the first 2 factors by confound- 
ing AB or AB’, and blocks of 2 on the second pair of factors by con- 
founding CD. Thus we are led to the following design for 2 replicates 
partially confounding AB and ABCD: 


I. | Io I. | Ia I. I/II. We | Ile IL; | Ile II/ 


Oa | la | 2a | 08 | 18 | 28 | la | 2« | Oa | 18 | 28 | 06 
18 | 28 | 08 | 1a | 2a | Oa 08 | 18 | 28 | Oa | la | 2a 


in which 
0 denotes the combinations on a and b: 00, 12, 21 
1 denotes the combinations on a and b: 01, 10, 22 
2 denotes the combinations on a and b: 02, 20, 11 
and 


a denotes the combinations on c and d: 00, 11 
B denotes the combinations on c and d: 01, 10 
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A second pair of replicates based on AB? could be used to give balance 
on the interaction of a and b. 

Numerous investigations have been made of other cases, for example, 
Li, Nair and Rao.** The reader may refer to these publications. The 
occasion will not arise frequently when designs other than those given 
here or easily derivable from those given here are desired. Frequently, 
when other cases are dealt with, a split-plot design or some other type of 
design is preferable. For example, a 5 X 2 experiment can be per- 
formed with a 5 X 5 Latin square with the plots split into 2 parts for 
the 2-level factor. Apart from familiarity with all the types of design, 
the only solution of this problem would be a dictionary of designs accord- 
ing to the structure of the treatments, but the value of such a dictionary, 
if constructed, would be somewhat doubtful unless it indicated the value 
of designs and how minor modifications in the structure of the treatments 
would enable a much better design to be used. 


18.8 PARTIALLY FACTORIAL EXPERIMENTS 


There is a class of experiments in which the treatment combinations 
have an appearance of consisting of a full set of factorial combinations, 
but are not in fact so. The simplest example of this type is that in which 
there are, say, 3 equally spaced amounts, including a zero amount of a 
particular treatment administered in 3 forms. If none of the amounts 
is zero, no new difficulty arises. 


Form 
Amount 1 2 3 
0 ive x 
1 9 
2 x * * 


At first sight there appear to be 9 treatment combinations, but there are, 
in fact, only 7 different ones, as the 3 forms at zero amounts consist each 
of zero application and are identical. The experimenter must consider 
whether he should use all 9 treatment combinations as though they are 
distinct or only the 7 distinct combinations, and further he should con- 
sider the method of analysis in each case. 

First, assume that all 9 treatment combinations are used and analyzed 


in the usual way. The 8 degrees of freedom would then be partitioned 
as follows: 


df 

Amount 2 
Form 2 
Interaction 4 
Total 8 


— 
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We notice that the comparison of forms will include a comparison of 
the zero treatment plots, which can contribute only experimental error. 
We make up the set of 8 orthogonal comparisons given in Table 18.14, 
the first subscript of the treatment symbol representing the form and 
the second the amount to indicate the defects of the above partitioning: 


TABLE 18.14. TREATMENT COMPARISONS 
Contrast 10 20 30 21 31 12 22 32 


- 
— 


AL 2 2 2 -1 -1 -1 -1 -1 -1 
f LN an % 
Py 2 -i -1 2 -1 -1 2 -1 -i 
Fg 0 1 -1 0 1 -1 0 1 -1 
AL XFi 4 -2 -2 -2 1 1 -2 1 1 
AL XF: O 2 —2 0 -i 1 0 -1 1 
Aq x sib, OO 06:753 2 1c a Uf 
A: X TF2 0 0 0 0 1 21 0 -1 1 


Because 01, 02, and 03 are, in fact, identical treatments, we see that 
F, and A X Fi estimate the same contrast of real treatments, apart 
from sign and different errors, and, likewise, Fa and Az X Fz estimate 
the same contrast. Thus, if we made an analysis in the above way, the 
sum of squares for interaction would include a component arising directly 
from the differences between forms. There are, of course, only 2 degrees . 
of freedom for the interaction of amounts and forms: namely, the inter- 
action of the table: 


Forms 
Amount 1 2 3 
1 BOX x 
2 xxix 


The best method of analysis for data of this type depends on the re- 
sponse law and how it may vary for each form. The situation may be 
represented as in Figure 20. 

Form 3 


Form 2 


Form | 


Yield 
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1f the response curves were straight lines, the hypothesis would be 
: yij = n fix + eij (plus replicate effects) 
= p+ jet -H A ey (21) 


The experimenter would then be interested in testing whether the 
(f; — f)’s are all zero. It would be advisable to include in the model 
a term for curvilinearity in the response, i.e., use the model 


Yy = wt fx + ge + eij , (22) 


If f; and g; are without restriction, we would be fitting 7 constants 
u, fi, gi to the 7 distinct yields, and there is little new to be said about 
the matter. It may be more reasonable to suppose that 


Vu = et fiz + m2? + eij 

Yaj = u + Mir Nga + esj 

Yaj = u + the + rnc + esj 
that is, that the basic response law is 


/ 


* 


Vij = uc fr gr (23) 


and that the forms differ in containing different concentrations of the 
basic causative factor. 

With the modification of the interaction given above, we would obtain 
the following estimates, for each of which we give the expectation: 


Linear effect of quantity: CU XT + 40 4- M + 7) 
Quadratic effect of quantity: 301 +A? + 7?)g 

Effect of forms: 3f, + 501, 8 + NY, 3771 + org 
Quantity X form: fi + 3g, Mi + N, vfi + 3701 


where the effect, of forms and the interaction are each given by 3 quan- 
tities which would be adjusted to add to zero. We see that this method 
of expressing the effects of form and its interaction with quantity is not 
satisfactory with the model we have assumed, for if 91 = 0, there is 
interaction of quantity and form. 

If the response law is assumed to be linear, i.e., that g; above is zero, 
the situation is simpler, and is, in fact, that described by Yates. The 
effect of form is proportional to the dose, and the best estimates of the 
differences between forms are given by the differences of the yield at 
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level 1 plus twice the yield at level 2. The interaction will then be 
twice the yield at level 1 minus the yield at level 2. With this method 
of estimation, the expectations of the estimates including quadratic 
terms are as follows: i 


Linear effect of quantity: 20 +A + fi +40 4X 4 7g 
Quadratic effect of quantity: 2(1 +” 4- 72g 

Effect of forms: 51 + 901, 9M + 41, 5rfi + 977g 
Quantity X form: 291, 291, 27291 


We note that if the relationships are in fact linear, i.e., 91 = 0, there 
is no quadratie effect of quantity, and also no interaction of form and 
quantity. If, however, there is curvature in the response law, the inter- 
action of form and quantity will contain some contribution arising from 
this source, when we would prefer it to be zero. This example is im- 
portant in indicating that a definition of interaction is a consequence of 
the definition of the main effect. A similar procedure may be used with 
any number of levels, equally or unequally spaced. 

Satisfactory methods for the analysis of such data have not been 
evolved for more or less general situations. The reader may refer to 
Finney 7 for a discussion of some of these questions in relation to bio- 
logical assay. The essential fact is that the experimenter should have 
ideas on response laws with his particular experimental material, be- 
cause, otherwise, it is impossible for him to characterize accurately the 
differences in forms. In the absence of such knowledge, he can always 
make the simple statement that, at particular dosages, one form gives 
a response a stated amount different from that due to another form, and, 
in order to make such statements, it will be necessary to remove effects 
of blocks and any other removable environmental effects. An impor- 
tant point in the design of such experiments is that the zero treatments 
be adequately represented because the yield in question forms the base 
point for the curves of the 3 forms. If the response law is known, this 
is not necessarily so. It is also important that no effects be confounded. 
It would, for example, be very unwise to test the forms on different 
groups of experimental units. If experimental cireumstances necessitate 
the testing of forms on different groups, the zero treatment, or even all 
the rates for one form, should be tested in each group. 

Of the same type, but giving more identical treatments, is the case 
mentioned by Yates! when we have levels of a treatment, form, and 
method of application if the lowest level is zero amount. For example, 
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with 2 levels, zero = (1) and l; 2 forms, fı, fo; and 2 methods, mi, m»; 
the 8 combinations are 


mifi, mfil, mfa, mifol 
mof, mafil, mof», maſal 


The combinations mifi, mifo, m»fi, and mof2 are identical and consist, 
in fact, of zero treatment. The appropriate method of analysis in such 
cases depends on whether the zero treatment is represented 4, 3, 2 times 
or only once but, in all cases, amounts to a suitable choice of individual 
degrees of freedom. For example, with 2 replicates, each of 7 plots, the 
control being represented 3 times, we have the 6 contrasts among the 7 
treatments or quasitreatments in a block shown in Table 18.15. 


Taste 18.15 

a 0 en mfi mfa mofil mafa 
Forms F -1 +1 -1 41 
Methods M —1 -1 H HA 
Forms X Methods FM +1 -1 -1 +l 
Levels L -4 -4 —4 +3 +3 73 +3 
Error Ei 1 -1 
Error Es 1 1 -2 


The structure of the analysis of variance will be: 


df 
Replicate R 1 
F 1 
M 1 
FM 1 
L 1 
Error E, EI X R 
Es Ez X R 8 
FXR MXR 
FM XR,LXR 
Total 13 


The sums of squares are ċalculated in the usual way. 

As a general conclusion for this type of experiment, in the absence of 
other overriding facets of the experimental situation, it is probably best 
to retain the full factorial structure which will allow use of the standard 
systems of confounding to reduce block size. In some cases, as in the 
second case discussed above, it may be possible to obtain a set of orthog- 
onal contrasts which are reasonable to the experimenter. In other cases, 
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when the response law is unknown, the best procedure is to estimate the 
yield of each treatment combination removing block effects. If there 
are dummy treatments which appear in the factorial structure to be dif- 
ferent, the mean of their adjusted values may be used as an estimate of 
the yield of the one distinct combination. 
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Split-Plot Experiments 


19.1 THE SIMPLE SPLIT-PLOT EXPERIMENT 


In the previous chapters we have covered the great bulk of experi- 
ments involving several factors which are likely to be of practical im- 
portance. For all these experiments, the main problem is to devise 
arrangements in small blocks, because the error variance of an experi- 
ment increases markedly with the size of block. The device of confound- 
ing is used to give arrangements in small blocks. In this way, we sacri- 
fice information on some effects and interactions (preferably high-order 
interactions) which the experimenter regards as trivial or unimportant, 
in order that we can obtain more information on the more interesting 
questions. With this exception, the experiments are so planned that 
the information (as measured by the reciprocal of the true variance) on 
effects and interactions is the same. In the case when an effect or inter- 
. action is confounded with blocks, we have ignored the fact that the 
block comparisons contain some information. Block comparisons, in 
fact, contain some information on treatment comparisons, which can be 
extracted if we can estimate the variance between blocks within a repli- 
cate which are treated alike. With a number of replicates of a con- 
founded design, this is, of course, possible, as the reader will have already 
noted, because we could, with some designs, obtain a test of significance 
of confounded effects or interactions. We shall strike the problem of the 
combination of this type of information, known as interblock or between- 
block information, with the other type of information, known as intra- 
block or within-block information when we discuss quasifactorial and in- 
complete block designs in later chapters. For most of the designs dis- 
cussed in previous chapters, the amount of interblock information is very 
small, and we did not consider its utilization, For designs using blocks of 
2 or 4 plots with several replicates, however, it might be well worth 
while to do so, and the appropriate methods will be given. 

We now come to a class of designs in which, for one reason or anot her, 
we plah to utilize the interblock information from the start and for 
which the interblock information is an essential part of the body of 
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information provided by the experiment. The structure of the experi- 
ments will be that of plots within blocks and blocks within replicates. 
The usual terminology is to refer to the blocks as whole plots and the 
plots as split plots. There is nothing essentially new in the design or 
analysis of such experiments, but they are sufficiently distinctive to 
merit separate consideration. These experiments are known as split- 
plot experiments. ‘ 

As an example, we could have the arrangement shown in Figure 21 
for testing 5 varieties each at 5 rates of planting. The basic unit or 
split plot would be chosen in the usual way; the plot would consist of 
5 split plots, and the replicate of 5 plots, with, say, 4 replicates. If 
rates of planting were the whole-plot treatment and varieties the split- 
plot treatment, each split plot within a whole plot would have the same 
rate of planting but a different variety. One replicate could look like 
Figure 21 in plan, the first symbol denoting the variety, and the second 
the rate of planting. 


Ficure 21. 


The double lines correspond to a grouping of the plots or experimental 
units on the usual basis for making up blocks, and the single lines sepa- 
rate the split plots. In a field experiment it is natural to make up the 
split plots within a whole plot in such a way as to sample best the whole 
plot, i.e., in the direction with the greater trend, and to lay out the whole 
plots within a replicate in such a way as to sample the replicate best. 
'The randomization procedure is to allot whole-plot treatments at ran- 
dom to the whole plots, and then to allot the split-plot treatments at ran- 
dom within the whole plot. It is usually desirable to have rectangular 
plots for field experiments, and a split-plot experiment in the field looks 
like the above plan. The effects of the restrictions in the design on the 
accuracy of estimates will suggest the principles on which the design is 


based. 
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The analysis of such an experiment will be based on the additive model 


Vir = w+ ri + tye + error (1) 
where : 
Replicate number „„ 
Whole plot treatment number = j = 1,2, „f 
Split- plot treatment number = k = 1, 2, „ 8 


The important question is the assumption that may be made about the 
error term. As in the case of randomized blocks and Latin squares, we 
regard this error term as arising because the treatment combination 4% 
falls on one particular plot rather than another. We note immediately 
that we cannot assume the errors to be homogeneous for all the treat- 
ment combinations. The treatment combinations with the same whole- 
plot treatment are restricted to lie within the same whole plot for each 
replicate. To elucidate the matter, we shall follow the same procedure 
that we used for the randomized block design. Suppose that the plots 
have basic yields £us, u, v being the whole-plot and split-plot numbers, 
and that the yield of treatment combination (jk) on this plot z;,,j is 
expressible as 


Liuvjk = inv + tjk (2) 
Then, as for the randomized blocks, we have the identity 
Tiuvjk = R.... H (T.... — m 8888 GC. % 1 ) 
F ( *.. — Berje . .. .) ＋ (Tei — Tt. 1) (3) 


which reduces to 
Tiuvjk = T. . + t.. + (. — z...) - (% — fs.) + (Tun — x.) (4) 


The treatment combination occurs on a randomly chosen plot, and we 
denote its actual yield by y;jx so that we have 


Vije = u + ri (lx — t.) + (Ties — 41.) (5) 
We may, furthermore, write 
tjk =t..+ (t. - tu) T (t. a b.) T (tk — lj. — 1.1 + p.) 


= b. +t + s+ (to) say (6) 
and, noting that 
Tiuv — Ti.. = (Ziu. — Tt. .) + Ziuv Tt.) (7) 


we have, on rearrangement, 


Vije = u + rit lj + (Ziu. — 26) + 8k (6) + (rus — Ziu.) (8) 
The observed yield may then be written 


Vr = u + ri + ti + niy + Se + (ls) jx + eije (9) 
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where 
"ij = Don (vin. — z;..) 
eijk = Z0 (run — Tiu-) 
8, = a random variable which takes the value of unity if treatment j 
occurs on whole plot u, and zero otherwise 
and 


die = a random variable which takes the value of unity if treatment 
combination (jk) occurs on plot (uv), and zero otherwise 


The errors n;; are correlated with each other, and the errors e are cor- 
related with each other, as in the case of randomized blocks. The above 
discussion dealt only with the plot errors, but, as in the case of random- 
ized blocks, we may regard the other errors as being included in the 
Nij and eijk 
To obtain the analysis of variance by the present approach, we make 
up a set of s orthogonal linear functions of the split-plot yields within 
“each whole plot as follows: 
Ciji = Mali + Maia K. ＋ N. 
Cio = Nay + Nola het Nos r (10) 


Cija = aij + N21 +--+ Ne 
where 


1 
AH . 


a 
Dd d\n = 0 for i = 2, 3, „8 
* (11) 


2$. Nikk = 0 for iz i 


k=l A 
2 My 1 
kel 
These comparisons are equal to the same comparisons of the £j,'s plus 
errors, which we proceed to examine. For any chi, we find that 
alg te V s(u + ri + ty + mio) (12) 
so that the quantities chi- A/s which equal the whole-plot means are 
given by 
Sean tnt ita (122) 
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This is a model exactly the same as for the randomized block. experi- 
ment for t treatments in r blocks of 1 plots, so that we know that the esti- 
mate of any comparison of the “'s is given by the comparison of the 
whole-plot means, and we obtain the analysis of variance: 


df 
Replicates r—-1 
"Treatment t-1 
Error (r 100 — 1) 


Considering now the other functions Cijk, k being unequal to unity, we 
note that the quantity (ru. — 7;..) is the same for all split plots of the 
same whole plot, so that, as regards the errors, we have orthogonal con- 
trasts of the quantities (Tun — Ft.). We found in the case of random- 
ized blocks that orthogonal comparisons of quantities such as these are 
'uncorrelated. Again, therefore, we may obtain estimates of the com- 
parisons of the (js, by taking the corresponding comparisons of the 
observed means of the comparisons’ over all replicates, The estimates 
of whole-plot mean comparisons and split-plot comparisons will be best 
linear unbiased estimates if the variance of the (z;,. — .) is the same 
for all replicates and the variance of the (z;,, — Tiu-) is the same for all 
whole plots. An analysis of variance may be made for the split-plot 
comparisons as for the whole-plot comparisons, and, if the whole plots 
are analyzed on a split-plot basis, that is, if the quantities c/n are ana- 
lyzed, the two analyses of variance may be combined into one, in such 


a way that the constituent parts add up to the total sum of squares 
about the mean. 


Tasis 19.1 ANALYSIS OF VARIANCE FOR A SrLrT-PLOT EXPERIMENT 


Dua to dj Sum of Squares 
Replicates R r—1 r Y... = n... 
ta rta 
Whole-plot treatments T t-1 Y YE m Ye 
ra rta 
* ya a 
RXT (r- = pre. TE pte, Be 
s ra ria 
Split-plot treatments S om! Ya Yt. 
rt ria 
y? ** * * 
SXT t= 06-1 F E- E. 
Ld r^ . 
Remainder . (r — D — n By subtraction 


— 


Total 71 1 - 
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If we denote the expectation of the whole-plot mean square by c? and 
of the split-plot mean square by ds, we find that the expectations of 
the mean squares are as indicated in Table 19.2. 


TaBLe 19.2 
Mean 
Square Expectation of Mean Square 
Whole-plot treatments T T At i — 1 > ej 
J 
RXT Ww o? : 
rt 
Split-plot treatments S 8 6. + 12 
j uu e y (ut 
SxT l I utga- a O” 
Remainder E os 


The results we have obtained could have been obtained from the model 
yk = n ri + lj + nij 8 + (ts)jk + eijk (13) 


in which the 7,;’s are normally and independently distributed with mean 
zero and variance o, and the eins are normally and independently 
distributed with mean zero and variance o”,. In that case, we would 
have - 

"d = G, 80°» 
In passing, it may be noted that the use of the finite model obviates 
one difficulty that arises with the infinite model: namely, that, apart 
from sampling errors, the whole-plot error mean square must be greater 
than E. With the finite model, this need not necessarily happen. The 
infinite model approach does, however, indicate that this will generally 
be the case. The expectations of the mean squares, which are the same 
for both finite and infinite models, indicate the appropriate tests of sig- 
nificance: 

1. To test (je O, J = I, t, i. e., that De; = 0, or that there are 
no differences between whole-plot treatments averaged over all the split- 
plot treatments, test T/W against the F distribution with (t — 1) and 


— — 1) degrees of freedom. 
** Mages : = 0, k = 1, rs sits that Leer = 0, or that there are 


no differences between split-plot treatments averaged over all the whole- 
plot treatments, test S/E against the F distribution with (s — 1) and 
(r — 1)t(s — 1) degrees of freedom. 
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3. To test that the interactions of whole-plot treatments and split- 
plot treatments are zero, i.e., that the (ts);,’s are all zero, test I/E 
against the F distribution with ( — 1)(s — 1) and (r — 1)t(s — 1) de- 
grées of freedom. 


As with randomized blocks or Latin squares, we rely on the approxima- 
tion by the F test to the randomization test and perform the tests as 
stated. 

It may be noted that, if the third test of significance gives the result 
that the interaction cannot be regarded as zero, the other 2 tests of 
significance may be somewhat irrelevant. If there is an interaction, 
both whole-plot treatments and split-plot treatments have an effect, 
but not in an additive way. Whether the whole-plot treatments aver- 
aged over the split-plot treatments or vice-versa differ insignificantly or 
not, when there is an interaction, may be of little interest because both 
sets of treatments have an effect. It should also be noted that there is 
no justification for testing the split-plot treatment mean square against 
the interaction mean Square, unless the interaction is, in fact, zero. If 
this were the case, this interaction sum of squares would not have been 
separated from the error mean square in the first place. A test against 
interaction is valid if the whole-plot treatments are a random sample of 
an infinite population of treatments, and this would then test for the 
existence of split-plot treatment effects averaged over the population of 
whole-plot treatments (see Chapter 28). 

If there are no missing data, all treatment comparisons are estimated 
directly as the corresponding comparison of observed means. Finally, 
in the interpretation of results, it is necessary to obtain the appropriate 
standard error for any comparison of the treatments. The general pro- 
cedure for this follows from the above description of the analysis. Any 
comparison of treatments can be expressed as a linear function of com- 
parisons of the two types, whole-plot and split-plot comparisons, given 
above. We list the types of comparison that can be made, all being ex- 
pressed on the basis of a split-plot yield: 


1. A comparison of whole-plot treatment means: Each whole-plot 
2 2 
mean has a variance of “(= ate), 
8 8 
treatment mean has a variance of c? /rs for comparison with other whole- 
plot treatment means. 
2. A comparison of split-plot treatment means: This comparison is 
estimated by the comparison of actual Means, each mean being the 
, mean of rt split plots and, therefore, having a variance of 0 /t. 


so that each whole: plot 
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3. A component of the interaction of whole-plot and split-plot treat- 
ments will have an error calculated in the usual way with a variance of 
c?, per split plot. For such comparisons, each treatment combination 
mean has a variance of c?,/r. 

4. The comparison of whole-plot treatments averaged over a set of 
d of the split-plot treatments, e.g., a comparison between the ¢ quantities 


1 
a; = a + fa boob ba), 1 1, 2, f 


has an error variance depending on both c? and c?^, To obtain the 
variance of each of these quantities we note that: 


(a) X = (ta + tig Fa) Ga boc tie) has a variance of 
8c? /r. 
(b) Y = (s — d)(ta + tig d: tia) — diia b tis) has a 


variance of (0,/r)[(s dd + d — d)] = (a?,/r)(s — d)ds. 
These two linear functions of the parameters are uncorrelated, and 
ta + tig d a X Y 
d ds 
It, therefore, has a variance 


„ 
. in) 


which equals 


1 — d 
— (2 + s 2 (14) 


TS d 


The estimated variance is then 


4. (w 1 D (15) 
rs d 

Tests of significance for comparisons 1, 2, and 3 above are made by 
replacing true variances by estimated variances and using the ¢ test 
with the appropriate number of degrees of freedom. For comparison 4 
an exact test of significance does not exist. The theoretical problem 
involved with the infinite model is: What is the distribution of 


_ Me + roy 
Mas, + Mos; 


where x, y are independent normal deviates with estimated variances 


s", and 8%, known to be estimates of different variances o°, and o°, 


t (say) 
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based on their respective degrees of freedom, and ^, Az are fixed con- 
stants. This has been given attention in the noted Behrens-Fisher 
problem, but the solution given by the Behrens-Fisher test is subject to 
considerable controversy as it involves the fiducial argument. A test 
that is possibly too conservative but otherwise seems reasonable is the 
t test based on (r — 1) degrees of freedom. Better still, a test of the 
comparison should be made by evaluating it in each replicate, and thus 
obtaining the estimated variance, based on (r — 1) degrees of freedom. 

The errors of the various types of comparison give an indication of 
the relative statistical value of the split-plot design. In general, c? will 
be greater than c?,, so that split-plot treatment comparisons are esti- 
mated more accurately than whole-plot treatment comparisons. In the 
absence of other conditions, this suggests which factor should be ap- 
plied to the whole plots. We shall discuss the efficiency of split-plot 
designs later. 


19.3 ARRANGEMENT OF WHOLE-PLOT TREATMENTS IN 
A LATIN SQUARE 


If the number of whole-plot treatments is less than 9, say, and the 
number of replicates can be made equal to the number of these trent- 
ments, it is possible to arrange the whole-plot treatments according to 
a Latin square, each whole plot being divided into the requisite number 
of split plots for the split-plot treatments. With 4 whole-plot treat- 
ments, /, 42, ts, and 44, and 2 split-plot treatments, s; and s», in a field 
plot test, we could have a random arrangement aş shown in Figure 22 
where whole plots are demarcated by double lines. 
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FIGURE 22. 
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The whole-plot treatments are arranged at random in a Latin square 
in the usual way, each whole plot is divided into 2 split plots, and the 
split-plot treatments are randomized within whole plots. The model for 
this experiment with t rows, ( columns, . whole-plot treatments, and s 
split-plot treatments is 


Wiki = B+ Ti + 6j + te me si + (% eia (16) 


where 1 = 1,2, . = 12, „ t; k = 1,2, % tjl = 1,2, 2% 8. 
The parameters t, 81, (ts) are defined as previously, and r; is the effect 
of the ith row, c; is the effect of the jth column; the nijk’S are uncorrelated 
variables with mean zero and variance c?, and the e;jj//s are uncorre- 
lated variables with mean zero and variance c. As a handy device we 
can also regard the distributions as being normal. 

We obtain the analysis of variance given in Table 19.3. 


TABLE 19.8 ANALYSIS OF VARIANCE FOR SrLrr-PLor EXPERIMENT ARRANGED IN 
A LATIN SQUARE 


Due to df Sum of Squares 
; e Y%;... : 
Rows R t — 1 2j — — correction 
* 
t 2 i 
Column C t-1 2; m correction 
J 
Y2.4 ) 
Whole-plot treatments T t-1 x SA correction 
Whole-plot error W ` (t— 1)(t — 2) By subtraction 
Y*;.. E 
Total for whole plots e-1 2j rps correction 
i 
; Y$24 f 
Split-plot treatments S 8—1 2 ia correction 
i Y? sat ; f 
Interaction ST (t — 1)(s — 1) 2 TX. correction SS for 
T — SS for S 
Error t By subtraction By subtraction 
Total s 1 »» Vn — correction 


Correction = ＋ 


The tests of significance, estimates, and variances of estimates are as 
for the case of the randomized block arrangement of whole plots. The 
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expectations of the mean squares for whole-plot error and split-plot error 
are, respectively, o? and a°, as before. If the infinite model is used, 
c? = c?, + so”, where on is the variance common to split plots in the 
same whole plot. 


19.3 EXTENSION OF THE SPLIT-PLOT PRINCIPLE 


The possible extensions and variations on the split-plot principle are 
too numerous to enumerate completely, and for the rest of the chapter 
we shall give some examples which illustrate the main points. 

With 3 factors denoted by the letters a, b, and c with levels a, b, and 
c, respectively, we may arrange the levels of the factor c on split-split 
plots, and the levels of factor b on split plots within whole plots to which 
levels of factor a are allocated. The method of analysis is entirely anal- 
ogous to that for the case of 2 factors. The analysis consists of 3 parts, 
between whole plots, between split plots within whole plots, between 
split-split plots within split plots, each part being put on the basis of 
a split-split plot in order that the parts may be combined into one com- 
plete analysis. : 

If t is the true yield of the combination with factor a at the jth 


level, b at the kth level, and c at the Ith level, we make up treatment 
comparisons as follows: 


aj = lj. — t... 
bpm da. — L.. 
(ab) / = t. — lj.. — t4. F t... 
€ 7 l4 — .. 
(ac) = tja — tj.. — t.a +b... 
(be) = Lg — £4. — Ua d t. 
(abe) n = been — ta. — 6.1 — io Gas + La — Lu 
Then we may write the model for the analysis as 
Vk = u + ri aj + (Ca) + by + (ab) + (rab); 
Fer + (ac) + (be) + (abe) ut + e (17) 


where 1 is the replicate number, u is the mean, 7, is the effect of the ith 
replicate, and (ra) / (rab) n, e are error variables with mean zero and 


variances , o°, and c?,,, respectively. With the finite model, the 
mean of whole plots, y;;..; follows the model 
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yg = p + Ti + aj (ra) 


Comparisons of split-plot means within whole plots will not involve the 
error terms (ra); and these lead to the split-plot analysis. Finally, 
comparisons between split-split plots within split plots will not involve 
the error terms (ra);; and (rab) ir, and these give the third part of the 
analysis of variance. The analysis of variance will have the structure 
shown in Table 19.4, the expectations of the mean squares for the infi- 
nite model being given in parentheses. 


TABLE 19.4 
' Mean Expectation of 
Due to df Square Mean Square 
Replicates 1 — 1 
4 a-l 
Error (r — 1)(a — 1) E (= 0745 + co, + beo?) 
B b-1 
AB (a — 1)(b — 1) 
Error (r — Da(b — 1) 8 02, c + co) 
c c-1 
AC (a — De — 1) 
BC (b — e — 1) 
ABC (a — 1)(6 — De — 1) 
Error r(ab — Ie — 1) a SS 02 
Total rabe — 1 


As for the case of split-plot experiments, there are several errors ap- 
plicable to mean yields, depending on the nature of the comparison 
being made. As an example, we may take the comparison obtained by 
expanding 


ag(bo + bi) (eo Tei) — ai(bo + b1) (Co + ei) 


i.e., t 
agboco + aobico + aoboci + aobicı — aboco — aibico — abot: — aybyey 
This will be estimated by 

Y-000 + Y-o10 + 001 + Y-011 — 00 — V 110 — Yao 7 Yan 


The error part in this expression may be written out rather quickly 
using the infinite model, thus, 


A(ra).o + 2(rab).oo + 2(rab).oi + e. 000 + €-o10 + e. 001 + e. 11 
— 4(ra)., — 2(rab).1o + 2(rab)-11 — 2-100 — €-110 — €-101 — e111 
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The expectation of the square of this is 
3207.» 4 168 8 


T T T 


À 8 8 - SS E — 
which may be estimated by — (ss +2 7 +4 : 
T 


bc 
In general, the variance of the estimated differenee between two whole- 
plot treatments, averaged over b' of the split-plot treatments in com- 
bination with c’ of the split-split-plot treatments, is 


from which the estimated variance may be obtained easily, using negative 
estimates of variance components if such occur. As degrees of freedom 
for a ¢ test in these cases, the author favors the number (r — 1)(a — 1), 
though this possibly results in slight underestimation of the level of 
significance. 


19.5 THE EFFICIENCY OF SPLIT-PLOT DESIGNS RELATIVE 
TO RANDOMIZED BLOCKS 


Under many circumstances the experimenter utilizes a split-plot de- 
sign for technical reasons. For example, one of the factors in an agro- 
nomic experiment may be such that it can be applied only to larger areas 
of land and not to the usual size of plot. In that case, the plots could 
be split for the other factor or factors, It is, however, of interest to 
evaluate the relative efficiency of the split-plot design, as this evalua- 
tion will suggest circumstances under which the design is more ap- 
propriate than randomized blocks, The analysis of variance with whole- 
plot treatments arranged in r randomized blocks is given in Table 19.5. 


TABLE 19.5 
Mean 
Due to df Square 
Blocks r-1 
Whole-plot treatments T t-1 
Error (r — 900 — 1) Ww 
Split-plot treatments S 8-1 
TXS (t — 9 — 1) 
Error (r — ts — 1) E 
— — 
Total ris — 1 


The estimated information on Whole-plot treatments is proportional 
to 1/W, and on split-plot treatments and interaction to 1/E. An esti- 
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mate of the error variance E', which would have been obtained with 
randomized blocks of size (s, and 1 plot for each treatment combina- 
tion per replicate, can be obtained by replacing the treatment mean 
squares by their appropriate error mean squares and evaluating the 
consequent mean square for treatments and error combined within rep- 
licates. Thus, 


E- r(t — 1)W + ri(s — E a 4 — DW + t(s — DE 


18 
ris — 7 18 — 1 G8) 


The information on all treatment comparisons would then have been 
proportional to 1/E'. E“ is a weighted average of W and E, and, be- 
cause W will be usually greater than E (except for sampling errors), E. 
will be intermediate in size between W and E. The information on 
whole-plot treatments relative to randomized blocks is then E'/W which 
is less than 1. For split-plot treatments and interactions the relative 
information is E//E which is greater than 1. These results express the 
obvious: that the arrangement of split-plot treatments together within 
a whole plot results in a lower accuracy on whole-plot treatment com- 
parisons and an increased accuracy on other treatment comparisons. 
The formulas enable a quantitative evaluation of these effects. Re- 
course should be taken to a split-plot design when experimental condi- 
tions necessitate the special arrangement, or when the experimenter is 
more interested in one factor, which he arranges within whole plots, 
than in the other. The use of a Latin square for the whole-plot treat- 
ments will tend, to a considerable degree, to lessen the differences in 
accuracy of the 2 types of comparison, because of the effect of the 2-fold 
restriction in reducing error variance. Yates! has published an exami- 
nation of experimental data, mainly agronomic, from the point of view 
of the efficiency of split-plot designs. A possible disadvantage under 
some circumstances, for example, when a partitioning of the treatment 
mean square into components of variance is contemplated, is the fact 
that whole-plot and split-plot comparisons may be of widely differing 
accuracies. 


E 


19.5 THE 2-FACTOR EXPERIMENT WITH BOTH FACTORS 
IN STRIPS 


Instead of the usual 2-factor split-plot arrangement, with the levels 
of one factor arranged at random within plots, the whole of which is 
receiving a constant level of the other factor, it is sometimes convenient 
to have both sets of treatments arranged as whole-plot treatments, also 
arranged according to a pattern. Agronomic experiments in which 
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both experimental factors are not easily applied to small areas are of 
this type. If the factors have a and b levels. respectively, the plan of 
1 replicate might be as shown in Figure 23. 


Level of First Factor : 
4 2 1 3 - = 


Level of 
Second Factor 


FIGURE 23. 


Levels of one factor are applied to rows at random and of the other 
factor to columns at random. At least 2 replicates are necessary, in 
order to provide estimates of error, With additivity of treatment effects, 
the model will be : 


Yije = p + Ti + aj + (ra)i + by + (rb) + (ab) jx + (rab); 
The terms in the model are defined analogously to the previous cases, 
but we may simplify matters by using the infinite model and suppose 
that the errors (ra);;, (b), and (Cab) ur are normally, independently 
distributed with means zero and variances o”,, o?e, and c?,, respectively. 
The structure of the analysis of variance is given in Table 19.6. 


TABLE 19.6 ANALYSIS FOR 2-Factor EXPERIMENT IN STRIPS 


W it df Expectation of Mean Square 
Treatments A a-1 e?, + be?, + p. Da, 
RXA (r — 1)(a — 1) Et 
Treatments B b-1 eh, -- ast, . Y. s, 
RX B (r — 1)(6 — 1) o’, + ao’, 8 
Interactions AB (a — 1)(6 — 1) — — LG 
R X AB ( = Dia - 0 — 1) E275 .,55 


Total rab — 1 
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Such a design gives relatively low aceuracy on both main effects with 
relatively high accuracy on the interactions. For example, the variance 
of the mean for each level of the first factor averaging over the levels 
of the second factor, for comparison with any other levels of the first 
factor, is 

os ek bos, e, c, 
qb A o Orb 


which will generally be dominated by the first term with a low number 
of replicates. The variance of any treatment comparison may be ob- 
tained by noting that the best estimate with complete data will be the 
same comparison of treatment means, and the variance of this compari- 
son is easily obtained from the model, as in previous cases. Estimates 
of variance components from the analyses of variance are then sub- 
stituted. 


19.6 SPLIT-PLOT CONFOUNDING 


So far in our use of the split-plot principle, we have assumed that 
plots are split into a number of parts equal to the number of levels of 
the split-plot treatment factor. This is frequently an overrestrictive 
condition on the design: for example, if the whole plot is a litter of mice 
and split plots are mice within the litter, it may well be the case that 
we can have a large number of litters with 4 mice, and we wish to test 
as split-plot treatments, say, 3 factors each with 2 levels, or 8 combina- 
tions in all, The procedure under such conditions is quite straightfor- 
ward, following from the descriptions of confounding in earlier chapters. 
Suppose there are 3 whole-plot treatments. It will usually be reason- 
able to assume that the 3-factor interaction of the 3 split-plot factors 
is of less interest than other comparisons. This interaction may then 
be confounded with whole plots. If the whole-plot treatments are bi, 
tə, and ta and the split-plot factors are a, b, and c, one replicate would 
contain 6 whole plots each split into 4 split plots as follows before ran- 
domization: 
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Comparisons of f;, tz, and ia averaged over the split-plot treatments will 
then be whole-plot comparisons, as will be the interaction ABC and the 
interaction of ABC with 11, ta, and tz. Effects A, B, C and interactions 
AB, AC, BC and the interactions of these 6 comparisons with £j, tz, 
and {3 will be comparisons among split plots. The analysis of variance 
will have the structure shown in Table 19.7. 


TABLE 19.7 
Expectation of 
Due to df Mean Square 
Replicates 1 — 1 
twtavta( T) 2 
ABC 1 
T X ABC 2 
Whole-plot error 5(r — 1) a’, ^ roh, 
A, B,C | 6 
AB, AC, BC 
TLA EXB T XC | 12 
T X AB, T X AC, T X BC 
Split-plot error 18% 1) . 
Total 24r — 1 


All other details of this design follow readily by the usual methods, 
the analogy with faetorial experiments being complete, except that in- 
terblock (= whole-plot) information is utilized. There are numerous 
extensions of this approach, which can be devised, given a particular 
investigation with formulated aims. 

An example with a Latin square is of some combinatorial interest 
(Finney ). Suppose 4 treatments are being compared by a Latin square, 
and it is desired also to test 2 factors, a, b, each at 2 levels by splitting 
the plots, but that the plots can be 
divided into halves only, smaller units 
being impractical. The interaction AB 
must then be confounded with whole 
plots, and it is desirable that it be un- 
confounded with rows and columns. 
That this is possible follows from the 
possibility of inserting rings in a 4 X 4 
square, such that 2 rings occur in each 

FIGURE 24. row, in each column, and with each 
treatment (Figure 24). 

The ringed squares would contain one of the 2 sets of treatments, 

(1) and ab, or a and b. The same device may be used with 3 split-plot 
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factors a, b, and c and the plots split into 4 parts confounding ABC. 
This type of design is possible only with squares of the first transforma- 
tion set. Similarly, for some 6 X 6 Latin squares, it is possible to as- 
sign rings to letters such that 3 rings occur with each row, column, 
and letter, leading to a corresponding design. It has not been verified 
that these designs are unbiased, and this is not an entirely obvious 
property. 
19.7 THE ANALYSIS OF COVARIANCE IN SPLIT-PLOT 
DESIGNS 


The theory of the analysis of covariance for split-plot designs follows 
directly from the case of the analysis of covariance in a 2-way classifica- 
tion, in the same way as does the analysis of variance. It will be re- 
membered (cf. Chapter 8) that the infinite model must be used. In 
the case of the analysis of variance of split-plot designs, the original 
general linear hypothesis which contained correlated errors was parti- 
tioned into 2 independent general linear hypotheses, one for the analysis 
of whole plots and one for the analysis of split plots. 

The structure of the analysis of covariance for the split-plot design 
will be identical to that of the analysis of variance and may be regarded 
as 2 separate analyses of covariance, one for whole-plot treatments and 
one for split-plot treatments (Table 19.8). 


Taste 19.8 

Whole Plots df y zy 2 
Reps r-i 
Treatments A t-1 Tw Tz Tz 
Error a (r — 1)(t — 1) Ww Way War 

Split Plots 
Treatments B s-1 Sw Szy Suz 
Interaction AB (t — 0s - 1) Ip Izy Taz 
Error b (r — 1)t(s — 1) Ew Ezy Ezz 


Again to facilitate the computation of the error b sums of squares and 
products, the whole-plot analysis is done on a split-plot basis; i.e., the 
sums of squares and products are computed from the whole-plot totals 
and then divided by s. 

In the case of split-plot experiments, we find that there are 2 error 
regressions of y on z, one for each error, say, Bw and g.. It may be noted, 
for example, that a regression common to all the split plots of a whole 
plot in no way affects split-plot comparisons. It is found that 
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Wry 
T 19 
E 7 (19) 
with estimated variance 
1 1 ( Ta) 
Wy — 20) 
(r 2 1)(t ^. 1) x Wess id Wa ( 
and that ^ 
zy 
5 21 
B E. (21) 
with estimated variance ; 
1 1 (z 5 Hn 
(r 7 1)t(s 2 1) "E 1 Ezz "n Ex 
The plot yields may be adjusted to the same value of x by calculating 
Vije — Bw (xij — i..) — B. xig — ij.) (23) 


We note that 8, does not enter into whole-plot comparisons and g, does 
not enter into split-plot comparisons. The errors of ad justed treatment 
comparisons may be evaluated by the usual rules. Tests of significance 
are made in the way usual for the analysis of covariance. 


19.8 MISSING DATA 


In the case of one missing split plot, the experiment may be analyzed 
by the analysis of covariance with a concomitant variable which takes 
the value of 0 for the plots with actual yields and —1 for the plot with 
missing yield. The above procedure then completes the analyses. This 
procedure actually amounts to the estimation of one missing value for 
the particular split plot and one for the whole plot containing the miss- 
ing split plot. This should not be & source of confusion when one con- 
siders the structure of the analysis of variance. It would be possible, 
with the infinite model, to obtain one solution only by maximum like- 
lihood, but the process would be very tedious, and we would then be 
unable to use the analysis of variance technique for testing purposes. 

The case of one missing whole plot has been examined (see also by 
Anderson *). In this case, the whole-plot analysis is performed as if 
there were no split-plot treatments, and the missing value is estimated 


ordinary way: that is, by taking a mean over all the replicates. Split- 
plot comparisons that involve the treatments of the missing whole plot 
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a simple computational procedure for the estimation of split-plot com- 
parisons and the split-plot error variance, values may be inserted for 
the missing plots equal to their mean over the replicates containing 
these. treatments, the analysis of variance completed, and the error de- 
grees of freedom reduced by the number of missing plots. Comparisons 
are then estimated by the comparison of treatment means of the aug- 
mented table. For the estimation of errors of treatment comparisons, 
it is necessary to evaluate the error as a linear function of the plot errors 
and evaluate its variance. The usual formulas, ignoring the fact that 
data were missing, probably underestimate the error only slightly. 

For the case of one missing split plot, an analogous procedure may 
be used. The whole-plot analysis is performed with a missing plot, 
and the split-plot analysis with a value inserted equal to (mean of ac- 
tual split plots in whole plot) plus (mean of the missing plot treatment 
over other replicates) minus (mean of other split plots of whole plots in 
which this treatment occurs). E 

The possible cases of missing data in split-plot experiments are very 
numerous. The number of configurations in which only 3 split plots 
are missing is large, including the cases of all in 1 whole plot, 1 in 1 
whole plot and 2 in another with the same split-plot treatment on 1, 
2, or all of the 3 missing split plots, and soon. Whether the expenditure 
of the necessary labor on obtaining accurate (in terms of general linear 
hypothesis theory) solutions for the ordinary experiment is worth while 
may be doubted. The best suggestion is that the experimenter make a 
guess by looking at the plan and yields of the experiment and thence- 
forward ignore the fact that data were missing. The field of statistics 
must, like all other sciences, exercise some criteria of value of particu- 
lar types of work, and it is not worth while generally to use what would 
be a complicated procedure on a small experiment. 
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CHAPTER 20 


Fractional Replication 


20.1 INTRODUCTION 


So far in this book, we have considered possible arrangements of the 
complete factorial system; that is, we have considered only arrange- 
ments in which each individual treatment combination of the factorial 
set is represented the same number of times. For example, with 5 fac- 
tors each at 2 levels, we have discussed arrangements of the 32 treat- 
ment combinations in blocks of 2 plots, blocks of 4 plots, 8 X 8 Latin 
squares, and so on, but always with the restriction that each of the 32 
combinations is to be tested an equal number of times. Such a restric- 
tion is practicable with a small number of factors, but, when we con- 
sider the case of, say, 10 factors each at 2 levels, it would result in the 
necessity of our testing 1024 combinations or a multiple of these. The 
main reason for imposing the restriction is that it results in the esti- 
mates of effects and interactions having maximum precision and being 
uncorrelated. Thus, to take a simple example, suppose we are evaluat- 
ing 2 factors, a and b, each at 2 levels, and test the treatment com- 
bination (1), a, b, ab with nj, na, na, n4 repetitions, respectively, in a 
single randomized block., Then each effect and interaction is estimated 


with variance 
ele b sy 
— (Fe = + ~) 
4\n, n m ny 
but the estimates are correlated thus: 


cov (4, 8) = (4-4 _ 1,1) 


. 


A. AD (AA 

4 m h ng n 
2 

cov (b, Ih (- Ll li, -) 
4 ni 


m nz 


and 
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These covariances will be zero if n, = No = ng m4. Furthermore, if 
we fix (nj + na + ng + na), the total number of observations, we ob- 
tain minimum variance for each of the effects and interaction with 
ny = Ng = Ng = Na. 

As we have seen throughout, the general problem of the design of ex- 
periments, we are given a model, and we wish to determine the parame- 
ters of the model with as low variance as possible. There are two 
methods by which this may be accomplished: namely, by choosing the 
pattern of observations, for example, equal n’s above, or by reducing 
the error variance c? by choice of design. 

The question we ask in this chapter is whether it is always necessary 
to test all the factorial combinations equally frequently or whether we 
can omit some of them. The question is of considerable relevance, for 
factorial experiments are most appropriate for exploratory research, 
and in such research the number of possible factors that should be 
tested is by no means so small as 2 or 3. For example, in research into 
the possible importance of the various vitamins in the nutrition of an 
organism, the number of factors that should be used is at least of the 
order of 10. It is, furthermore, important to use a factorial system be- 
sauso we cannot assume all interactions to be negligible. The testing 
of 1024 treatment combinations may be virtually impossible from the 
practical viewpoint. If the whole 1024 combinations were tested, the 
subdivision of the 1023 treatment comparisons would be: 


Main effects 10 
2-factor interactions 45 
3-factor interactions 120 
4-factor interactions 210 
5-factor interactions 252 
6-factor interactions 210 
7-factor interactions 120 
8-factor interactions 45 
9-factor interactions 10 
10-factor interactions 1 

Total 1023 


It may well be reasonable to assume that high-order interactions are 
negligible, and, if for instance all interactions involving 3 or more fac- 
tors could be ignored, the testing of the 1024 combinations would give 
an estimate of error based on about 950 degrees of freedom. The accu- 
racy that would result for the estimation of main effects and interactions 


(a variance of «2/256 where c* is the experimental error variance) might 
well be unnecessarily high. We may then ask what information can 
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be obtained from the testing of a lesser number of combinations. We 
shall, in fact, find that information on-main effects and interactions for 
all the 10 factors can be obtained under some mild assumptions from 
the testing of 512, 256, or perhaps even 128 of the total of 1024 combi- 
nations. The general process by which this is accomplished is known 
as fractional replication. 


20.0 A SIMPLE EXAMPLE OF FRACTIONAL REPLICATION 


Suppose we are testing 3 factors, a, b, and c, which are known not to 
interact. For example, we might wish to weigh 3 small objects by a 
chemical balance, the procedure being to place the objects in the right- 
hand pan and then to place known weights in the left-hand pan to bring 
the pointer to the zero position. The treatment combinations will then 
. consist of: 

Objects in 
Right-Hand Pan 

None 

1 

2 

land 2 

3 

1 and 3 

2 and 3 

1, 2, and 3 


SNS % 8 


i The relation between the true yields and the effects and interactions 
in the ordinary 3-factor situation is shown in Table 20.1. 


TaBe 20.1 
True 
Yield 2E =i 4B łaB łc jac BC }ABC 
E A o - 
a + + - - - — + + 
b t. = * - - 4 - + 
ab + + + + > - - - 
c V LA = 15 + — — + 
ac 1 i+ - = + * - = 
be + = * - + — * es 
dc | + + + + + + + + 


Suppose that we test only the 4 combinations, a, b, c, and abe. Then 
we see from the table that we can estimate the quantities (u + 144ABC), 
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14(A + BC), E + AC) and 14(C + AB), but that it is impossible 
to separate the A effect from the BC interaction, the B effect from the 
AC interaction, the C effect from the AB interaction, or the mean y 
from the ABC interaction. In fact, we have the following 4 estimating 
relations: i 


u + 3ABC is estimated by 4 +b + c + abc) 
1(A + BC) is estimated by l(a — b — c + abc) 
1(B + AC) is estimated by 1(-a + b abo) 
3C + AB) is estimated by 1 -a — b + c + abe) 


(1) 


where a, b, c, etc., are now the observed yields. We may say that, with 
these 4 observations only, A is completely confounded with BC, be- 
cause there is no possibility of estimating A alone and BC alone but 
only their sum. Similarly, B is completely confounded with AC, C 
with AB, and ABC with p. This confounding, however, need not. 
cause the experimenter any worry if he is prepared to assume that the 
interactions are negligible. The second, third, and fourth comparisons 
may be used to estimate the 3 main effects, and the estimates are un- 
correlated, In this simple example, there is not, of course, any possi- 
bility of estimating the error variance, and we would not use this de- 
sign for any practical purpose. It serves, however, to bring out the 
main idea of fractional replication, that a suitably chosen subset of the 
full factorial set can provide worth-while information. The above ex- 
ample utilizes 44 replication of the 2? system, because we have tested 
only 4 of the 8 combinations. 

We could equally well have used the set of treatment combinations 
(1), ab, ac, and be, and it may be verified that the estimating equations 
will be: 


u — }ABC = 1) + ab + ac + be] 
}(A — BC) = 1(- (D + ab + ac — be) 
&(B - AC) = H- + ab de + be] 
3% — AB) = H- ab + ac + be] 
and interaction is almost the 


(2) 


The confounding among mean, effects, 


same as before. 4 ; : 
The dominant feature of this example is the choice of the interaction 


ABC and the selection of either the treatments entering positively in 
this interaction or those entering negatively. For most purposes, we 
may disregard which half of the treatment combinations we choose, 
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because we shall always choose an interaction in such a way that those 
interactions that are completely confounded with the effects or inter- 
actions we wish to estimate are assumed on the basis of prior knowledge 
to be negligible. 

If we use the equality sign to denote “completely confounded with,” 
we may write the confounding relations above in the form: 


A= BC 
B= CA (3) 
C = AB 
and, if by convention we denote y by I, also 
I-ABC . ; (4) 


We note that the first 3 equalities are obtained from the fourth by re- 
yarding the relationship as an algebraic identity and I as unity and us- 
ing multiplieation with the rule that the square of any letter is to be 
replaced by unity. Thus, 


I = ABC 
when multiplied by A gives 


A = A?BC = BC since A? =1 
when multiplied by B gives \ 

B = AB = AC since B = 1 
and when multiplied by C gives 

C = ABC? = AB since Ca =1 


Thus, we can treat these effect and interaction symbols as ordinary alge- 
braic quantities except that the square of any letter is unity. 

Another example would perhaps be instructive. Suppose then that 
we select those treatments that appear positively in the AB interac- 
tion. We shall then have 4 observations: 


(1) = 4 — 34 - $B + 14B — 3C + 44C + )BC — }ABC + e, 
ab = u + 3A + 3B  )4B — 3C - 414C - 9BC — )ABC +e 

0 = 14 }B + 4AB + 3€ - 44C - BC + SABC +e 
abc = p + $A + 3B AB + 3C + 140 + 4BC + SABC + e, 


or 


(5) 
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(1) = (u + AB) — (A + B) — (C + ABC) + $(AC + BC) + e 
ab = (u + 3AB) + (A + B) — 3(C + ABO) = &(AC + BC) + e 
c = (ut 3AB) — (A + B) + &(C-- ABC) — (AC + BC) + es 
abc = (u + 3AB) + YA + B) + (C + ABC) + (AC + BO) + & 


(6) 
The confounding relations are given by the equations: 
A=B 
C = ABC 
(7) 
AC = BC 
and 
I = AB 


The first 3 of these relations may be obtained from the fourth by 
multiplying both sides of the fourth equation by A, C, and AC, respec- 
tively, with the rule that A? = BP =C? =1. 

In each of these two examples we have used a 14 replicate of the full 
set of factorial combinations. Our original assumption was that we 
were testing 3 factors which do not interact: that is, that the true in- 
teractions AB, AC, BC, and ABC are zero. The first 14 replicate we 
considered is then a satisfactory experiment (apart from the fact that 
no estimate of error can be made) because we can estimate each of the 
3 effects, A, B, and C. In the second l4 replicate design considered, 
however, the effect A is confounded with effect B, and this is entirely 
contradictory to the aim of the experimenter. 

The crucial part of the specification of the design is clearly the choice 
of the relationship I = ABC or I = AB. This relation is known as the 
defining relation or identity relationship. Once this relationship is 
chosen, we can specify the functions of the parameters which can be 
estimated, and the choice of a relationship is based on this fact. Thus, 
we would not use a relationship that results iri the confounding of main 
effects with each other. We now proceed to a more realistic case. 


20.3 1⁄4 REPLICATION OF A 2° EXPERIMENT 


Suppose we have 6 factors, a, b, c, d, e, f, each at 2 levels, and wish to 
test only 32 of the total of 64 possible treatment combinations. We 
follow the lines of previous examples in testing those treatment combi- 
nations that appear positively in the expression for the 6-factor inter- 
action: that is, the treatment combinations that contain an even num- 
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ber of letters (zero being regarded as even). The confounding relations 
are then as in Table 20.2. : 


Taste 20.2 CowrovNpiNG RELATIONS IN 14 REPLICATE or 2° FACTORIAL 


EXPERIMENT 
I = ABCDEF E = ABCDF 
A = BCDEF AE = BCDF 
B = ACDEF BE = ACDF 
AB = CDEF ; ABE = CDF 
C = ABDEF CE = ABDF 
AC = BDEF ACE = BDF 
BC = ADEF BCE = ADF 
ABC = DEF ABCE = DF 
D = ABCEF DE = ABCF 
AD = BCEF ADE = BCF 
BD = ACEF BDE = ACF 
ABD = CEF ABDE = CF 
CD = ABEF CDE ABT 
ACD = BEF ACDE = BF 
BCD = AEF BCDE = AF 
ABCD = EF ABCDE = F 


We have thus accounted for the 64 parameters, the mean u, and the 
63 main effects and interactions, and each one is confounded with the 
one with name complementary to it in ABCDEF. Each of the 31 com- 
parisons between the yields of the 32 treatment combinations, which 
have the property of being linear with coefficients of plus or minus 
unity, measures the sum of an effect and an interaction or of 2 inter- 
actions. The 2 effects or interactions estimated by the same contrast 
are said to be aliases of each other. Now, suppose all interactions in- 
volving 3 or more factors are zero. We may then use the comparisons 
to estimate main effect, 2-factor interactions, or error, as the ease may 
be. We have, in all, 10 comparisons which may be used to estimate 
the experimental error: namely, ABC — DEF, ABD — CEF, ACD — 
BEF, BCD = AEF, ABE = CDF, ACE = BDF, BCE = ADF, ADE 
= BCF, BDE = ACF, CDE = ABF. The following breakdown in the 
analysis of variance may then be made: 


df 

Main effects 6 

2-factor interactions 15 

Error 10 
Total 31 


In this way we have obtained a satisfactory design for estimating 
the parameters in the following mathematical model: 
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eaf = ut At Bt AB4C4AC 4 BC+ D+ AD 

* BD +CD + E + AE + BE + CE + DE + F + AF + BF 

2 * CF + DF + EF + eilen (8) 


— where the sign for each of the letters 4, B, C, D, E, F is plus if the cor- 
- responding subscript on the left is 1 (ie., the factor is at the higher 
level) and minus otherwise; the signs on interaction terms are the prod- 
- uet of the signs on the main effects, A is the mean, and the éjjz1mn's are 
uncorrelated with a mean of zero and a variance of c?. 

. The experimenter would probably regard the experiment given in the 
previous paragraphs as rather unsatisfactory ‘because it utilizes a ran- 
domized block of 32 plots. Let us examine the possibility of using blocks 
of 16 plots and blocks of 8 plots. If we are to use blocks of 16 plots, 
one of the 31 possible comparisons must be confounded with blocks, 
and we can choose any one of the 10 comparisons which we have used 
above for the estimation of error. Suppose we confound the compari- 
son that estimates ABC and DEF. The structure of the experiment 
will, apart from randomization, be as in Table 20.3. 


Taste 20.3 1% REPLICATE or 2° DESIGN IN 2 BLOCKS OF 16 Prors 


The analysis of the experiment will consist of the evaluation of the 
31 comparisons, and this may be done by the addition-subtraction proc- 
ess described in Chapter 14 for the complete 2" factorial system. For 
the arrangement of the yields in the standard pattern, one factor, say, 
f, is ignored completely. In this way, all 31 contrasts will be estimated, 
but some of them will have to be renamed, as, for example, the contrast 
computed as ABCD which will be renamed EF. 

If we consider now the possibilities of blocks of 8 plots, it will be 
necessary to confound between blocks 3 comparisons, each of which is 
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the product of the other 2. Some care is necessary in the choice of these 
3 comparisons. If, for example, we confound ABCD, ABEF, and 
CDEF, then we are, in fact, also confounding EF, CD, and AB, because 


I = ABCDEF 
ABCD = EF 
(9) 
ABEF = CD 
and 
CDEF = AB 


Such a system of confounding is unsatisfactory because 3 of the 15 
2-factor interactions are confounded, and they involve all the 6 fac- 
tors. An alternative system is the following, in which are confounded 


ABC = DEF 
and 
ABD = CEF (10) 
and 
CD = ABEF 


This is the best that can be obtained with blocks of 8 plots. The reader 
may verify easily that any other system would result in the confound- 
ings of some main effects or main effects and interactions or more 2-fac- 


tor interactions. The actual design before randomization will be as in 
Table 20.4. 


TABLE 20.4 1% Repuicate or 2° Desian in 4 Brocks or 8 Prors 
Block I Block II Block III Block IV 


(1) lac ad ae 
ab be bd be 
acde de ce ed 


bede abde abce abed 
acdf df ef edef 
bedf abdf abef abcdef 
GA acef adef af 
abef beef bdef bf 


The method of obtaining the contents of each block easily is: 


1. Form the intrablock subgroup which consists of all treatment com- 
binations that have an even number of letters in common with ABCDEF. 
ABC; and ABD. The first block is made up of the intrablock subgroup 
combinations. In obtaining these, it is useful to note that the elements 
in the intrablock subgroup form a group in that the product of any 2 
elements in the subgroup is also in the subgroup. In forming the prod- 
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uct, the usual rule of replacing the square of a letter by unity is to be 
observed. Thus, ab X aede = abcde = bede, etc. 

2. Form the other blocks by multiplying the elements of the first 
block by a treatment eombination that does not already oceur in previous 
blocks and that has an even number of letters in common with ABCDEF. 


20.4 A SIMPLE EXAMPLE OF 4 REPLICATION 


We take the case of 5 factors, a, b, c, d, and e, each at 2 levels, for 
purposes of illustration. We may select half of the treatment combina- 
tions on the basis of one interaction, and among these select half on the 
basis of another interaction. For example, suppose we select first on 
the basis of the ABC interaction: then we would have the treatment 
combinations (or its complement, and we consider only the one case), 


(1), ab, ac, be, d, abd, acd, bed 
e abe, ace, bee, de, abde, acde, bede 


Now, from these we select those treatment combinations that occur 
with the same sign (negative, say) in the interaction ADE. We have, 
finally, the following 8 combinations: 

(1), be, abd, acd, abe, ace, de, bede 


Note that these treatment combinations have the same sign in the in- 
teraction BCDE (they all occur positively). It is a general rule that 
we have used previously in our discussion of confounding that, if a 
treatment combination has an even number of letters in combination 
with ‘an interaction X and with an interaction Y, then it also has an 
even number of letters in common with XY, the generalized interaction 
of X and Y. If we examine the expected value of each of the selected 
treatment combinations, in terms of the full factorial model, we find 
the following: 


(1) = a — M'- 48 — 4c — 4D! - 1 + KBDY + 0 

be = p — 43A + 18 + dct 0 - 38 - 0D — }(BE)' 
abd = y + 44 + 4B! pO 0% + HBDY — 4(BE)' 
acd = w + 4A" J L 4C 4- 4D! - V" 360 + g 
abe = p + M! Mr — 4C 30 3E EED) + }(BE)' 
ace = p’ 4 4A’ — Mr + 40’ — 4D! + VE + KB) — AEV 

de = y — 4a! - Mr- 4C + 4D! + 4B’ - KBDy — K(BEY 
bede = p’ — BA’ + J + 30 + ÀD' + BE + BD + }(BE)’ 


(11) 


400 FRACTIONAL REPLICATION 


where : 
wW =u — 1ABC — 3ADE + 3BCDE 


A' = A — BC — DE + ABCDE 
B'- B AC — ABDE+ CDE 
€ = C — AB — ACDE + BDE 
D = D — ABCD — AE + BCE 
E' = E — ABCE — AD + BCD 
(BD) = BD + ACD + ABE + CE 
(BE) = BE — ACE — ABD + CD 


Formally these expressions may be written A (1 — ABC — ADE + BCDE), 
B(1— ABC — ADE -- BCDE), etc. 

With these 8 observations, we can estimate the 8 new parameters, 
u, A', B', C', D', E', (BD)', and (BE)'. Clearly estimates of these new 
parameters are of no value to the experimenter unless we can isolate 
oné of he terms in each of A’, B’, C", etċ., and assume that all the other 
terms are zero. If the experimenter is prepared to assume that all inter- 
actions are zero, the 8 treatment combinations are sufficient to give es- 
timates of the effects A, B, C, D; and E. In fact, it is obvious and may 
be verified easily by least squares that, under this condition, the best 
estimate of A by A is given by 


4Á = —(1) - be + abd + aed + abe + ace — de — bede 


that is, 44 equals the sum of plots eontaining a minus the sum of those 
not containing a, The other effects are estimated similarly, and -the 
corresponding estimators of (BD)! and (BE)! provide an estimate of 
error based on 2 degrees of freedom. 

The whole of the design and analysis of this trial may be simply de- 
duced from the identity 


I = -ABC = —ADE = --BCDE (13) 


We interpret this identity relationship as follows: The treatment com- 
binations that are used are those that occur negatively in the ABC in- 
teraction, negatively in the ADE interaction, and positively in the BCDE 
interaction. As a result, any effect or interaction X is inseparable from 
or completely confounded with the generalized interaction of X with 
ABC, of X with ADE, and of X with BCDE, and the comparison of 
combinations positive for X minus those negitive for X in fact esti- 
mates X — XABC — XADE + XBCDE. The 8 treatments are said 


(12) 
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to constitute a 14 replicate of the 2° experiment on a, b, c, d, e, based on 
the identity relationship or defining relation 


I = —ABC = —ADE = +BCDE 


There are, in all, 4 possible 14 replicate designs which result in the same 
interconfounding: namely, those based on the above identity and the 
following identities: 


I = +ABC = +ADE = +BCDE 
I= +4BC = +ADE = -BCDE da) 


$ 


and 
I = —ABC = +ADE = -BCDE 


The 4 possible 14 replicates are not generally worth distinguishing from 
the practical viewpoint, because one may be changed into the other by 
suitable interchanging of the levels of the factors, and it is usually suf- 
ficient to consider any of the 4 as being given by the relationship 


I = ABC = ADE = BCDE » 


20.5 14 REPLICATION OF A 2* EXPERIMENT 


The 14 replicate design in the previous paragraphs is of little practical 
use except in a problem for which interactions are zero: for example, 
in the weighing of small objects. We proceed to discuss an example that 
will be of considerable utility in many fields of research. 

Consider an experiment on 8 factors, a, b, c, d, e, f, g, h. We shall 
attempt to find a design using only 64 of the possible 256 combinations. 
If we can assume that all interactions involving 3 or more factors are 
zero, but 2-factor interactions must be included in the model, we must 
use an identity relationship such that all the terms in it apart from the 
identity involve at least 5 letters. A possible one is 


I = ABCDE = ABFGH = CDEFGH 


We wish the terms to involve at least 5 letters, because, with each term 
that has 4 letters, six 2-factor interactions will be mutually confounded 
in pairs. If any term has only 3 letters, a main effect will be confounded 
with a 2-factor interaction. The above identity relationship is then a 
suitable one, and we may choose any one of the 4 possible 14 replicates 
based on it. 

We must now examine the possibilities of arranging the 64 chosen 
treatment combinations in blocks of 16 or, if possible, 8 units. Con- 
sider first the case of blocks of 16 units: Any interaction confounded 
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with blocks must be such that the other interactions confounded with 
blocks by virtue of the identity relationship also involvé at least 3 let- 
ters. Below is given the identity relationship followed by 3 compari- 
sons suitable for confounding: 


I = ABCDE = ABFGH = CDEFGH 
ACF = BDEF = BCGH = ADEGH 
BDG = ACEG = ADFH = BCEFH 
ABCDFG = EFG =CDH = ABEH 


These relations give us 4 possible designs in blocks of 16 units, and we 
may take which one we please. For convenience, we take that design 
which includes the control treatment and construct the intrablock sub- 
group which is then one of the 4 blocks. The following rules are suffi- 
cient to determine the intrablock subgroup: 


(15) 


1. All the treatment combinations are even with respect to ABCDE 
and ABFGH (and therefore CDEFGH), and with ACF and BDG and 
therefore with respect to all the interactions in the four relations. 

2. The treatment combinations in the intrablock subgroup form a 
group in that, if z and y are in the group, so is the product zy obtained 
by combining z and y, dropping common letters. (Other properties are 
also necessary in order that they form a group, but these are of no con- 
cern in the present problem.) 


With these rules, we find that the intrablock subgroup consists of the 
following treatment combinations: 


(1), ach, aef,  cefh 
bdh, abcd,  abdefh, bedef 
beg, abcegh, abfg, — befgh 
degh, acdeg, adfgh, cdfg 


These were generated by noting that each of ach, aef, bdh and beg has 2 
letters in common with all the interactions in the 4 identities, and they 
are not obtainable from each other by taking products. 

The whole design (Table 20.5) before randomization is obtained by 
writing down the intrablock subgroup as block I; multiplying its ele- 
ments by an element (ab, say) which is known, from the identity rela- 
tionship to be included in the experiment, to give block II; multiplying 
the elements of intrablock subgroup by another element not already 
enumerated which must be included (ce, say) to give block III; and, 
likewise, with a multiplier of, say, de to give block TV. 
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Tak 20.5 14 REPLICATE OF 2° Desian IN 4 Brocks or 16 Prors 


Block I Block I Block III Block IV 


(1) ab ce de 

ach bch aeh acdeh 
aef bef . acf adf 
cefh abcefh fh cdfh 
bdh adh bedeh beh 
abed ed abde abce 
abdefh defh abedfh abfh 
bedef acdef bdf bef 
beg aeg beg 

abcegh cegh abgh abcdgh 
abfg fg abcefg abdefg 
befgh acfgh befgh bedefgh 
degh abdegh cdgh gh 
acdeg bedeg adg acg 
adfgh bdfgh acdefgh aefgh 
cdfg abcdfg defg cefg 


The analysis may be performed by dropping the letters a and f from 
the treatment combinations, thus regarding the experiment as a full 
. replicate on 6 factors, b, c, d, e, g, h, and using the addition-subtraction 
process to obtain the values for the 63 comparisons of the 64 yields. 
These will have names involving 1 to 6 of the letters B, C, D, E, G, H, 
and they may then be renamed by the use of the identity relationship 


I = —ABCDE = —ABFGH = CDEFGH (16) 


in which it is necessary to insert the-appropriate signs on the terms. 
The signs are determined by the fact that we have used the VA replicate 
which contains the control, so that we have taken the negative part of 
the first 2 interactions and the positive part of the third. In this way, 
assuming interactions involving 3 factors or more to be zero, we rename 
for example BCDE to be —A, CDEGH to be F, and BGH to be —AF. 
The analysis of variance will have the structure: 


df 

Blocks 3 
Main effects 8 
2-factor interactions 28 
Error Á 24 
Total 63 


The variance of each estimated effect or interaction will be 92/16, where 
c? is the error variance. 
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Now let’ us consider blocks of 8 units for this 14 replicate experiment. 
There is no simple set of rules that lead us to a design, but there does 
not appear to be a design in which no 2-factor interactions are con- 
founded with blocks. The following set of equations define a design in 
which two 2-factor interactions are confounded with blocks: 


I = ABCDE = ABFGH = CDEFGH 


confounding with blocks the following comparisons: 


ACF = BDEF = BCGH = ADEGH 
BDG = ACEG =ADFH = BCEFH 
ABCDFG = EFG = CDH = ABEH 
CDF = ABEF = ABCDGH = EGH 

AD = BCE =BDFGH = ACEFGH 
BCFG = ADEFG = ACH = BDEH 
ABG C DEG =FH = ABCDEFH 


The contents of each block are given in Table 20.6. 


Taste 20.6 ½ REPLICATE or 28 Desan 1N 8 Brocks or 8 Prors 


I Il III IV V VI VII VIII 
(1) ab ce de fg gh acf bdh * 
abed ed abde abe ^ abcedfg abcdgh bdf ach 
cefh abcefh — fh cdjh cegh . cefg aeh bedef 
abdefh defh abcdfh abfh abdegh — abdefg bedeh aef 
beg aeg beg bdg bef beh abcefg degh 
acdeg bedeg adg acg acdef acdeh defy abcegh 
befgh acfgh befgh bedefgh bch bef abgh cdfg 
adfgh bdfgh acdefgh aefgh adh adf cdgh abfy 


The analysis of variance may be performed as with blocks of 16: 
namely, by dropping the letters a and f, performing the addition-sub- 
traction process, and renaming according to the identity I  — ABCDE 


P = CDEFGH. The structure of the analysis of variance 
will be 


Interactions AD, FH 
Block error 

Main effects 

2-factor interactions 

Error (within block) 


LEN P T S 


Total 
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The 2 confounded interactions will be estimated with a variance 
equal to (block error mean square/16) and all the main effects and the 
other interactions with a variance equal to (within block error mean 
square/16). ` 


20.0 ONE-IN-2? REPLICATION OF THE 2" FACTORIAL 
SYSTEM 


The extensions to higher degrees of fractional replication are intui- 
tively obvious. If a fraction one in 2? of a 2" factorial system is used, 
there will be 2^7? treatment combinations actually tested with (2 — 1) 
degrees of freedom among them. Of the total of (2^ — 1) effects and 
interactions in the full model, 2? — 1 will be confounded with the total, 
and the remaining 2" — 2? will be mutually confounded in groups of 
2”, there being (2 — 1) such groups. The identity relationship will 
be of the form 


6777 ¶ » U= (17) 


there being p interactions X, V, Z, U, etc., none of which is obtainable 
from the others by multiplication. We give the following designs which 
may have some value. 

With 10 or more factors, it is possible to estimate main effects and 
2-factor interactions from 1 of a replicate if 3-factor and higher-order 
interactions are negligible. A suitable identity relationship with 10 
factors, a, b, c, d, e, f, g, hy J, K, is: 


I = ABCDE = ABFGH = CDEFGH = ACGJK = BDEGJK — , 
= BCFHJK = ADEFHJK (18) 


Thus the 10 main effects and the 45 two-factor interactions are ob- 
tained by testing 128 of the possible 1024 combinations. These may be 
arranged in blocks of 32 units by confounding comparisons which may 
be denoted by ABJ, ADF, and BDFJ. The intrablock subgroup for 
this design-is: 


(J), cek, abcd, abdek, abfg, abcefgk, cdfg, defgk, ghk, cegh, abedghk, 
abdegh, abfhk, abcefh, edfhk, defh, begj, begjk, acdegj, adgjk, aefj, acfjk, 
bedefj, bdfjk, behjk, behj, ardehjl:, adhj, aefghjk, acfghj, bedefghjk, bdfghj. 
Arrangements in blocks of 16 units for which main effects and 2-factor 
interactions are not confounded with blocks have not been found. 

A second example is a !4g replication of a 2!? experiment. If the 
factors are denoted by a, b, c, d, e, J. g, ^ j, ^, l, m, a suitable identity 
relationship is 
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I = ABCDE = ABFGH = CDEFGH = ABJKL = CDEJKL 
= FGHJKL = ABCDEFGHJKL = ACFJM = BDEFJM 
= BCGHJM = ADEGHJM = BCFKLM = ADEFKLM 
= ACGHKLM = BDEGHKLM (19) 


If comparisons denoted by ABM, DFH, and ABDFGM are confounded, 
we have a design in 4 blocks of 64 plots which enables estimation of all 
main effects and 2-factor interactions. The intrablock subgroup con- 
sists of the treatment combinations which have an even number of let- 
ters in common with ABCDE, ABFGH, ABJKL, ACFJM, ABM, and 
DFH. 


20.7 THE VALUE OF FRACTIONAL DESIGNS 


It is difficult to place a value on the individual experiment. A good 
experiment may be characterized to some extent by a good choice of 
factors to be tested and by good experimental technique. There are 
other imponderables such as the value of the aims of the experiment, 
whether the experiment is likely to lead to a clearer understanding of 
basic processes, and so on. For purposes of discussion let us suppose 
that the object of the experimenter is to determine the factors that pro- 
duce a certain result and the relative importance of these factors. In 
such cireumstances the experimenter must obtain by observation and 
intuition an idea of the factors that may possibly influence the character 
in which he is interested. When the experimenter has reached this situ- 
ation, fractional designs are of real value. They may be used to deter- 
mine which of the possible factors are of importance relative to a given 
error of predietion. Once these factors have been discovered, it is nec- 
essary to perform detailed work on the factors, possibly even one at a 
time in order to formulate a law relating response to dosage for each 
factor. Only when the response to dosage is known as a mathematical 
relationship does a branch of enquiry resemble an exact science. One 
difference between the biological and physical sciences lies in the fact 
that in the physical sciences the experimental material can often be 
brought to any desired degree of purity and can be examined by vary- 
ing one factor at a time, the errors of prediction being small relative to 
the magnitudes of the effects involved, whereas in the biological sciences 
this is not possible. A further difference between the physical sciences 
and the biological sciences is that the experimental unit in the biological 
sciences is much more complex than the physical science unit and can- 
not easily, if at all, be broken down into simpler units. 
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If the criterion of value of the experiment is related to the number of 
main effects and low-order interactions discovered by the experimenter, 
fractionally replicated designs may have considerable value, for a large 
number of effects and low-order interactions may be estimated. A diffi- 
culty in the evaluation of an experiment is the value to be attributed 
to information on the various effects and interactions, and the relative 
value to be attributed to estimates applicable to limited situations and 
estimates of perhaps lower precision applicable to less limited situations. 

We have discussed f ractionally replicated designs which are suitable 
if the experimenter can assume interactions between 3 or more factors 
to be negligible. Many-of the designs we have given ean be used if a 
few of the 3-factor interactions cannot be assumed negligible. A more 
detailed examination of possible identity relationships and systems of 
confounding will be necessary, but, apart from this, there is no further 
difficulty. : t 

The principle of fractional replication may strike the reader as being, 
based on unwarranted assumptions. It should be pointed out that the 
‘necessary assumptions are no more exacting than the assumptions made, 
for example, with a single replicate of a 2° factorial experiment: namely, 
that all interactions involving 3 or more factors are negligible or that a 
specified set of the 3-factor interactions and all interactions involving 
more than 3 factors are negligible. 

The value of fractionally replicated designs lies in the same phenomena 
which make the factorial design valuable, in that the experimenter can 
rarely assume that interactions between the factors which themselves 
affect a characteristic, biological or physical, do not exist, before he has 
conducted experiments. On the other hand, what we know about re- 
sponse curves suggests that high-order interactions will be small rela- 
tive to the experimental errors usually encountered. If high-order inter- 
actions are important, the experimenter will soon discover the fact by 
any design in which the factors are varied simultaneously. An experi- 
mental check is perhaps advisable in most cases when a highly fractional 
design is used, for example, by the use of two repetitions of the basic 
fractional replicate. In this way an estimate of experimental error un- 
contaminated by high-order interactions would be obtained, and this 
could be compared with the estimate of error obtained from the high- 
order interactions. 

Usually the experimenter is in the position of being able to impose 
treatments on and to examine a certain number of experimental units. 
He is also in the position that he can think of many factors which should 
be investigated. We may, therefore, ask whether we can apply any 
criteria of value to possible experiments on this fixed number of experi- 
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mental units. To be specific, let us suppose that 128 experimental units 
are available; then the experimenter can use any of the following de- 
signs, staying within the 2" factorial system: 


Number of Number of 
Factors Replicates 
64 


O O n 


m 


Of course, in some situations, there are not more than 3 factors that 
the experimenter considers worth examining, and, even if there are 10 
factors, the experimenter can possibly guess very accurately which 5, 
say, of the 10 factors are really important. On the other hand, there 
appears to be a little evidence, for example in nutritional work on bio- 
logical organisms, that the “best” experimenter’s guess in such a situs- 
tion turns out, with the accumulation of research results, to be not at 
all accurate. The comparison of the possible designs listed above is, 
at best, a hazardous procedure. It is, however, the responsibility of the 
experimenter and statistician to attempt to make the comparison, par- 
ticularly as the experimenter alone may be unaware of all the possi- 
bilities. 

As regards the amount of information given by the above possible 
designs, we can state that the 1-factor experiment will determine the 
effect of the chosen factor over a limited range of circumstances with a 
variance of 07/32. The effect of each factor will be determined with 
the same variance for all the designs listed, but, as more factors are in- 
troduced, the effect is estimated for the average of a wider set of condi- 
tions specified by the other factors that are varied. The fact that the 
estimate is for a wider set of circumstances may be an advantage or dis- 
advantage, depending on the circumstances and aims of the experi- 
menter, but it will usually be advantageous in the long view. In evalu- 
ating the designs, it is also necessary to put a value on the knowledge 
obtained about interactions, particularly 2-factor interactions, which we 
regard a priori as likely to be of greater importance. The lower the 
number of replicates used in the above designs, the higher will be the 
value of the designs, if knowledge of the existence of interactions is of 
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some value. The reader will find it instructive to consider the case when 
the experimenter favors the use of 2 replicates, but wishes to test 10 
factors and can perform the experimental work on only 128 experimental 
units at a time. Considerations of this type make the fractional de- 
signs very valuable under some circumstances. The choice of a frac- 
tional design does, however, require considerable care, and the experi- 
menter would be unwise to use this type of design at any available op- 
portunity without examination of all the facets. 

We have scen that it is difficult, if not impossible, to obtain fractional 
designs in small blocks without confounding important contrasts. This 
implies that it may be worth while under some circumstances to use 
what would be considered large blocks in order to include many factors 
and obtain comparatively precise information on the effect of each. 
The extent to which this will be worth while will depend partly on the 
relationship between error variance and size of block for the experi- 
mental material under consideration. In the discussion above we have 
ignored the fact that, with more factors included, the error mean square 
will be based on a lower number of degrees of freedom. The effect of 
this on the accuracy or sensitivity of the experiment will be small. 
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CHAPTER 21 


The General Case 


of Fractional Replication 


Fractional replication is of most practical utility when the factors 
each have 2 levels. The process, however, can be of utility for the other 
cases, and, in addition to giving the general theory, we shall include in 
this chapter an actual example on factors with 3 levels. 


, 


21.1 FACTORS AT THE SAME PRIME NUMBER (f) 
OF LEVELS 


In Chapter 17, we gave the definitions of effects and interactions for 
the p" factorial system, and found expressions for the yields in terms of 
effects and interactions. The latter may be expressed as follows: 

lik... = p+ 2) (S. a Hei f ) Ame: ttg (1) 
(e, 02^ --) and s 
where the symbol 


a mii bei =1, if at + aj +--- E smod p 


7 0 otherwise 
and the summation is over the unique set of points (o, ao, ) for the 
possible effect and interaction symbols A“B® .... 
In testing the full set of treatment combinations in a randomized 
block, we would have the general linear hypothesis 


Fus ea e (2) 


laras: J and s 


n — 
This is a general linear hypothesis on [ ES ( -) »| parameters, 
p — 


oe 
the parameters satisfying ( ri ) conditions, namely, 


D A"B"..-0 (3) 
: 410 
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for each choice of (o1, az, +++). The problem is to estimate u and esti- 
mable functions of the 4% B - --, that is, the effects and interactions. 
Now we may suppose that only those treatment combinations that. 
satisfy 

Byz + Bote ++- + Bur, = mod p a) 


. are tested. The following coefficients in the model will be equal for all 
the plots: 


5 aizi tagt 5 (ai Bx (a ir: ii 
8 , a 
8, 1 T 3802i-F (astata e etc. to get oz Din los (o Déser t 


The effects or interactions denoted by Ae pn „ en ee, 


for X = 1, 2, «++, p — 1 are, therefore, mutually confounded, that is, 
cannot be estimated separately, and the model may be written 

Yijke = 1 n pig teen du pet t 5 * + eijk--- (4) 
where 3 


p-l 
A“ po LÀ =, A21 BS ee. P Aspens wee (5) 
Awl 


and X’ denotes summation over a subset of EET choices out of the 


1 50 — 
total of ( i ) distinct choices of (a1, ao, , an). 
p- 
We may regard this design and its analysis as being given by the re- 
lationship 


I= AP p^ PAM i (6) 
and this relationship defining the design has the properties; 


1. The treatment combinations actually tested consist of those com- 
binations for which LS = O mod p. 

2. Any set of (p — 1) degrees of freedom X is completely confounded 
with (4 .. X, X = 1, 2, «++, p — 1, or, in other words, X and 
X(A® B® .. ^ are mutually confounded. 

Corresponding to a particular choice of (81, 82° * ) there are p different 
(1/p)th replicates specified by 

gr = | mod p (i) 
where ! can take any one of the values 0, 1, 2, . % p — 1. These differ- 
ent (1/p)th replicates are exactly the same as far as their practical 


value is concerned, and any one may be obtained from the others by 
interchanging the levels of one of the factors for which 8 is not zero. 


H 
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In exactly the same way a 1-in-p' replicate is specified by a relation- 
ship of the fórm 


I=X=Y = XY XT... XVI 
(oT2-2X-2Y! N 
= ZY = ZY? =... = ZYP- 


-= ZY'X'[r, s= 1,2, Wes (p esi 100 
= ete. : (8) 


there being t symbols, X, Y, Z, . ., none of which is contained in the 
generalized interactions of any of the others. 
Any effect or interaetion V not contained in the identity relation- 


— 1 
ship will be completely confounded with the 6 =) — 1 generali ed 
p= 


interactions of V with the symbols other than unity in the identity 
relationship. 3 

Having examined the structure of the 1l-in-p* replicated factorial ex- 
periments, we may now consider the circumstances under which they 
may be regarded as providing good designs. If the experimental ma- 
terial is such that interactions involving more than 2 factors are negli- 
gible, we may use a 1-in-p‘ replicate, if we can find an identity relation- 
ship that results in main effects and 2-factor interactions being con- 
founded with high-order interactions but not with each other. 

For example, with p = 3, n = 3, and the identity relationship 


I = ABC 
we may generate the resulting confounding: 
A =ABC = BC 
B AB -4C 
€ = ABC? = AB 
AB? = AC = BC? 


In this way the 8 degrees of freedom between the 9 results are parti- 
tioned into 4 sets of 2 degrees of freedom, each line corresponding to a 
set of 2 degrees of freedom. Clearly this design is of no practical value 
unless the 2-factor interactions are zero. The situation is much the 
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same with a 1% replicate of a 3* experiment, the best that can be done 
being to confound 2-factor interactions with each other. 
With 5 factors each at 3 levels, the 44 replicate based on 


I - ABCDE à (9) 


(or any of the cases I = A B*C"D'E', q, r, s, t all > O, correspordingly), 
we have the following confounding: ? 


A = AB'C?D*E? = BCDE 

AB = ABC?D*E? = CDE 

AB? = AC?D*E? = BODE? 
with similar relationships from interchanging letters A and B with C, 
D, or E. The model, for which any of the 3 sets of 81 of the total of 


243 treatment combinations specified above would be an adequate test, 
is 


Yijkim = u + A; + Bj + AB. ＋ ABs 40; + Ce + 4010 + AC?; 49% 
+ BC + BC?;42% + Di + ADi + AD*; 491 + BDj41 
+ BD; 43i + CDN + CD? 2t + Em + AEB i+m , 
+ AE?; 49m + BEA + BE?;42m CEA + CE! gam 
+ DEU + DE* 142m + eijkim (10) 


where i, j, k, I, m denote the levels of the factors a, b, e, d, e and the sub- 
scripts of the terms on the right-hand side are reduced modulo 3: that is, 
a model in which the interactions of 2 factors do not depend on the 
value taken by any other factor. 

The only other general aspect that needs consideration is the arrange- 
ment in blocks of the treatment combinations to be tested. If all the 
treatment combinations that lie in a block satisfy the relationships, 


Tic. = l mod p 


(11) 
Tor = m mod p 


then these combinations also satisfy the relatiors, 
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Z(y; 15 „r, mod p 
Z(0; + M3j)r; = m mod p 


(12) 


and so on, for \ = 1, 2, . . ., p — 1, if the fraction for which Egi; = 0 
mod p is used. If an effect or interaction W is confounded with blocks, 
then so are all the generalized interactions of W with the elements of 
the identity relationship. 

Let us examine the 14 replicate of a 3° experiment from the point of 
view of possible arrangements in blocks of 27 plots and blocks of 9 
plots. We suppose the identity relationship chosen is 


I = ABCDE 


If we confound ABC with blocks, we will also confound ABC(ABCDE) 
= ABCD?E? and ABC(ABCDE)? = DE, which does not meet our re- 
quirements that we do not wish to confound main effects or 2-factor 
interactions. If we confound ABC?, we also confound ABD?E? and 
CD°E?, and these then constitute a suitable system of confounding for 
blocks of 27 plots. It may be verified that in order to use blocks of 9 
plots it is necessary to confound at least one 2-factor interaction: The 
following may be confounded with blocks to give this result: 


ABC? = ABD'E!. = CDE? 
ABD = AC*DE? = BCE? 
ACD? = ABCE = BDE 
BCD = ABO = AE 


To specify the actual arrangement of treatment combinations, we utilize 
the facts that the block containing the control has all the members of 
the intrablock subgroup and that the other blocks may be obtained by 
multiplication of the intrablock subgroup by any treatment combina- 


tion that occurs in the trial. The intrablock subgroup consists of the 
treatment combinations which satisfy ; 


(13) 


Ks uice ir 
Ti + 22 + 273 = 0| mod 3 (14) 
zı ＋ 222 +r - o 


These treatment combinations form a group, for, if (yi, «++, Yn) and 
(21, +++, Zn) satisfy these equations, then so does (Yi + 21, ½ + 22, 


[4 
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Yn + Zn), and the control (O, O, . , 0) serves as the unit element, the 
law of combination being addition modulo 3. The intrablock subgroup 
is as follows, where we may adopt either form of representation: 


(0, 0, 0, 0, 0) (1) (2,1,0,2,1) ` able 
(1, 0, 1, 272) acd?e? (0, 2, 2, 2, 0) 520202 
(2, 0, 2, 1, 1) ade (1, 2, 0, 1, 2) ab?de? 
(0, 1, 1, 1, 0) bed (2/371 01 a?b?ce 


(1, 1, 2, 0, 2) abc*e? 


The other blocks are obtained by multiplying this block by cee, ce?, ae. 
de, cde”, cd, cd?, cde. It may be noted that the elements (1), c*e, 
ce”, de, des, cd, d, ed”, and cde form a group, the rule of combination 
being ordinary multiplication with the conditions that a? = b = à = 
de = é = 1. The product of this group and the intrablock subgroup 
make up all the treatment combinations vested. 

A striking example of fractional replication given by Fisher was de- 
vised by Tippett. Consider 5 factors, a, b, c, d, e, each at 5 levels, and 
suppose all interactions are zero. How many treatment combinations 
must be tested in order to discover which factors have effects? Suppose 
we have a E = 125 replicate of the 3125 possible combinations based 
on the identity relationship consisting of ABC, AC?D, BDE, and all 
their interactions. In order that the fractional design thus designated 
be useful for the present purpose, it is necessary that no 2-factor inter- 
actions be contained in these interactions: 


1. (ABC (ACID). Al+*BC'+*"D", r = 1, 2, 3, 4; if 1 +r =0, 
1 + 2r = 0, all numbers being reduced modulo 5, 80 that any of these 
interaction terms contains 3 letters. 

2. (AC?D)(BDEy = ABCD r = 1, 2, 3, 4; clearly all terms 
certainly contain at least 4 letters. 

3. (ABC)(AC?D)' (BDE) = AV" BU"CUPT DIME", r, 8 = 1, 2, 3, 4; 
if s = 4, 1 + s = 0, but it is then impossible for 2 of the quantities, 
1 +r, 1 -+ 2r, and r+ s, to be zero: if s 4, at least one of 1+r, 
1 + 2r, and r + s must be non-zero. 


We have, therefore, an identity relationship which contains no 2-factor 
interactions. If we are sure that interactions between the factors are 
trivial compared to main effects, we may use the 25 treatment combina- 
tions to test the main effects of the 5 factors. The intrablock subgroup 
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for this identity relationship may be obtained by solving the 3 equa- 
tions: 
qı ＋ 12 ＋ 73 = 3 
Ti X 273 ＋ = 0 mod 5 
12 ＋ T4 ＋ 75 — 0 


The solutions are generated by taking MX + MF where X = (10114), 
Y = (01422) and Xi, A» = 0, 1, 2, 3, 4. 


(00000) (01422) (02344) (03211) (04133) 
(10414) (11331) (12203) (13120) (14042) 
(20323) (21240) (22112) (23034) . (24401) 
(30232) (31104) (32021) (83443) (34310) 
(40141) (41013) (42430) (43302) (44224) 


The design used by Tippett brought to light immediately the factor and 
its level which was producing the response. 


21.2 THE FORMAL EQUIVALENCE OF FRACTIONAL 
REPLICATION AND CONFOUNDING 


The device of confounding may be represented by the addition to the 
factorial scheme of a number of pseudofactors whose combinations rep- 
resent the blocks of the experiment. Consider the confounding of ABC 
for a 3° experiment in blocks of 9 plots. Suppose we attach to the sym- 
bols for treatments in the block containing the (ABC); combinations 
the symbol d;, thus making the experiment 1 on 4 factors a, b, c, and d. 
The 27 combinations of the 4 factors actually represented are a 14 rep- 
licate of the total of 81, given by the identity 


I.— ABCD? 
for the comparison represented by 
D = ABC = ABCD 


and is the comparison of the 3 blocks, We may, therefore, obtain the 
design and the arrangement in blocks immediately by specifying the 
identity I = ABCD?, the last factor d being understood to give the 


blocks. The formal equivalence may be seen by noting that the com- 
binations tested will satisfy, say, 


7i + 29 + 23 + 2r, = Omod 3 
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so that, when 
z4 = 0, 11 + 22 Fra = 0) 
14 =l, 11 + T2 + T3 1 mod 3 


4 2, 21 22 +73 = 2 


when 


and, when 


The joint problem of confounding and fractional replication for p" 
systems reduces then to the enumeration of identity relationships for 
fractional replication. If we need a 1-in-p' replicate of a p" experiment 
in p” blocks (r < n — t), we need a 1-in-p'*” replicate of a p"** experi- 
ment. 'The requirements on the identity relationship are not quite so 
exacting as in a true case of fractional replication, for the identity re- 
lationship can contain terms involving only 4 letters if one of them cor- 
responds to a block pseudofactor. Operationally the author's experi- 
ence is that this equivalence is not of much help, because methods of 
enumeration of fractional designs with a small fraction have not been 
evolved. Rather, the equivalence is sometimes useful in the other di- 


rection, that, once a design with a 1-in-p' replicate of a p" experiment 
n+l 


with p” blocks is enumerated, it is easy to specify a 1-in-p^ ! of a p 
design with pri blocks. 

A group of designs may, for example, be deduced from that given in 
Chapter 20 for a Vs replicate of a 2˙ë experiment. The identity rela- 
tionship was 


I = ABCDE = ABFGH = CDEFGH 
= ABJKL = CDEJKL = FGHJKL = ABCDEFGHJKL | 
= ACFJM = BDEFJM = BCGHJM = ADEGHJM 
= BCFKLM = ADEFKLM = ACGHKLM = BDEGHKLM 


If the factor m is regarded as giving 2 blocks, the above identity rela- 
tionship provides a 14 replicate of a 2"! experiment in 2 blocks. Similarly, 
we may obtain a 4 replicate of a 210 in 4 blocks, a 14 replicate of 2° in 
8 blocks, and a full replicate of a 2° in 16 blocks. 


21.3 THE EFFECT OF BLOCK-TREATMENT INTERACTIONS 


The formalization which has been given above enables a simple ex- 
amination of the possible effects of block-treatment interactions on the 
interpretation of a confounded experiment. Consider a 2° experiment 
on factors a, b, ¢, d, and e, the 32 combinations being arranged in blocks 
of 8 plots confounding ABC, ADE, and BCDE. This experiment may 
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be represented as a 14 replicate of a 2’ experiment by introducing block 
pseudofactors f and g, say, the identity relationship being 


I = ABCF = ADEG = BCDEFG (15) 
If there are differential effects of the factors from block to block, the 


interpretation is exceedingly difficult, for we have as a result of the iden- 
tity relationship the following relations: 


AB = CF, AD = EG 
AC = BF, AE = DG (16) 
BC = AF, DE = AG 


Of the total of 10 two-factor interactions, 6 could be interpreted as 
block-treatment interactions. If there are significant block-treatment 
interactions but no interactions between the factors, the usual method 
of analysis will tend to indicate the presence of 2-factor interactions. 
This is not particularly surprising in that the usual method of analysis 
assumes additivity of block, treatment, and error contributions and can 
hardly be expected to be satisfactory when additivity does not hold. 
The reason for stating the position is that it is important for the-experi- 
menter to be aware of the possible difficulties. In discussing the rules 
by which blocks of the experimental units should be chosen, we stated 
that as much heterogeneity of experimental material as possible should 
be removed by the blocks. This rule should be followed only so long as 
additivity can reasonably be expected to hold. Block interactions will, 
over a number of experiments, tend to average to zero, because groups 
of treatment combinations are allocated to the blocks at random, so 
that the problem is not so important in groups of experiments as in a 
single experiment. In addition to noting the effects of block-treatment 
interactions on estimates of effects and interactions, we may also re- 
mind the reader of the relevant discussion in Chapter 8, which amounted 
essentially to the fact that, with block-treatment interactions, we can- 
not obtain an estimate of the true error variance to which comparisons 
are subject. 

Examination of the possible presence of block-treatment interactions 
for factorial experiments on some field crops (Yates,? Kempthorne *) 
indicated that they were fairly certainly small. This is, of course, evi- 
dence in only one small branch of the application of experimental de- 
sign. 
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21.4 FRACTIONAL REPLICATION OF MIXED FACTORIAL 
SYSTEMS 


By a mixed factorial system we mean the system obtained by taking 
all the combinations of m factors at p levels, n factors at q levels, and 
so on, where p and q are prime numbers. We dealt briefly with the diffi- 
culties of confounding with this system, and we shall encounter the same 
difficulties in fractional replication. 

In order,that a set of treatment combinations be a fractional replicate 
of the simplest type, the number of treatment combinations must be a 
factor of p"q", say, equal to p^g^ which will be a 1-in-p"—*q"—* repli- 
cate. ‘This may be effected by picking a set of (m — a) independent 
effects or interactions from the possible (p" — 1)/(p — 1) of the first 
group, and a set of (n — b) independent effects or interactions from the 
possible (q" — 1)/(q — 1) of the second group of factors. The treat- 
ment combinations tested will then be based on 2 identities. 

A l=X=Y=Ze=ete. = XY = = XY] = eto. (17) 
an : 
l=U=V=W = ete = U-. UV = ete. (18) 
The confounding among the effects and interactions may be obtained 


from the identity relationships. 
Suppose we have p = 3, m = 4, q = 2, n = 4 with factors a, b, c, 
d, e, f, g, h in order. A 16 replicate could be based on the identity rela- 


tionships, I = ABCD 
I = EFGH 


There will be 3° x 2 = 216 treatment combinations, and it may be 
verified that the following confounding among effects and interactions 
oceurs. 


A = ABCD? = BCD i 
and similar relationships obtained 


AB = ABODE SEG by permuting the letters ABCD 
AB? = ACID! = BCD? : 

E = FGH and similar relationships obtained 
EF i GH by permuting the letters EFGH 


In addition, the following interactions, for example, are mutually con- 
founded: 4 = A= BCDE 
= AFGH = AB*C?D?FGH = BCDFGH — 


420 THE GENERAL CASE OF FRACTIONAL REPLICATION 


in which, while we use the symbolism appropriate for pure systems, we 
must interpret a symbol such as BCDFGH to be the interaction of the 
3 X 2 table: 
(BCD), (BCD); (BCD)i 
(FGH)o z z z 
(FGH), z z z 


The above example is of little practical value, for 2-factor interactions 
are inextricably mixed. It illustrates, however, the main difficulty with 
mixed systems, that one must, so to speak, work within groups of fac- 
tors each at the same number of levels. 

In view of this, there is little to be said on fractional replication of 
mixed systems. If there is a sufficient number of factors at one of the 
levels to enable fractional replication on that set of factors, fractional 
replication may be used. The advantages to the experimenter of hav- 
ing the same number of levels for most of the factors are rather strik- 
ing. They lie in the facts that, with the same number of levels, simple 
systems of confounding and fractional replication exist and the analysis 
of the experiment is straightforward. ^ 


21.5 OTHER FRACTIONALLY REPLICATED DESIGNS 


We have, in all cases so far, considered a fractional replicate of a p" 
experiment which contains p' treatment combinations, where s is less 
than n. It is not necessary that we restrict ourselves in this way, and 
we can, in fact, make up a l- in- r fractional design, in which k is any 
number between 1 and p'. There do not appear to be any extensive 
investigations for cases when k is greater than unity, and the possibili- 
ties are certainly considerable, though not necessarily of practical value. 

As an example, let us suppose that an experimenter wishes to test 5 
factors each at 2 levels, but has only 24 experimental units. Further- 
more, suppose interactions involving 3 or more factors can be assumed 
to be very small. As a possibility, we could suggest a 34 design made 
up of a 14 replicate based on the identity i 


I = —ABCDE (19) 
and the JA replicate based on the identity (note that the signs are 


specified) 
I = ~ABC = -CDE = ABDE (20) 
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'The analysis follows from the normal equations which, under the as- 
sumptions, are of the form: 


6A 
-24 
6B 
240 
60 
20 
-26 
6D 
20 
6f 
—22 
6aD 
64 
6BD 


6BE 


250 = HA] 
+ 6BC = ABC] 
2 = HB 
+ 6B = [AC] 
— 24B — 2DE = MCI 
+6AB ABI 
+ 6DE = MDE] 
-2È == HID (21) 
+ 60 = HCE] 
- 26D = MEI 
+ 66D = HCD] 
= HAD] 
= MAE] 
= MBDI | 
- MBE] 


where [A] denotes the sum of the combinations containing a minus those 


not containing a, [BC] the 
BC positively minus the 


sum of the terms whose expectations contain 
sum of terms whose expectation contains it 


negatively. It follows, therefore, that 


var (A) = var (B) = var 


~ 


(D) = var (Ê) = var (BC) = var (AC) 


= vat (GB) - we (OD) - 35 
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2 


cov (A, BC) = cov (B, AC) = cov (D, CE) = cov (B, CD) = E 


* 95? ~ S 8 2 
var (C) - 2 var (AB) = var (DE) = z 


— — 2 


` ~ ~ c? g 
= = —;, B, DE) = — 
eov (C, AB) = cov (C, D. d cov (A ) p 


— — e? 
AB, DE) = — 
i gale dq 


o? 


var (AD) = var (AE) = var (BD) = var (BE) = 7 
all unmentioned covariances being zero. 

For the 14 replicate alone, we know that each effect and interaction 
will be estimated with a variance of c?/4 and that all the estimates will 
be uncorrelated. The use of thé additional 14 of a replicate has, there- 
fore, resulted in lower variances for all the estimates, but has intro- 
duced correlations between some of the estimates of up to 14. These 
correlations will render tests of significance somewhat tedious, as they 
are a concomitant of the non-orthogonality present. 

The example we have considered is not a 34 replicate in the sense 
that 34 of the combinations are tested. Ideally, perhaps, we would 
take a V4 replicate with }4 of the remaining 14 replicate. Suppose we 
consider the 2° case and take the 14 replicate based on the identity 


I = —ABCDEF (22) 
and the A replicate based on the identity 
I = +ABCDEF = ABC = DEF (23) 


where we note that the 4 replicate is not in the chosen 16 replicate. 
This set of treatment combinations will lead to the following typical 
normal equations: 

For A: 


124 + 4BC = MA] 

P (24) 
4A + 12BC = }{BC] 

with similar equations for Ê and AC, C and AB, D and EF, Ê and DF é 

P and DE. 
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For AD: 
12AD = HAD (25) 


with similar equations for AE, AF, BD, BE, ÉP, CD, CR, and CP. 


It follows, therefore, that the variance is 307/32 for each main effect, 
likewise for 2-factor interactions partially confounded with main effects, 
and 92/12 for all other 2-factor interactions. The covariance of an ef- 
fect and interaction which are partially confounded is —o”/32, so that 
their correlation is 4. It may be noted that, if we take the reciprocal 
of the variance as the amount of information, then the full replicate or 
14 replicate gives 1/40? units of information per plot while the 34 repli- 
cate gives 2/90” units of information per plot. It will, in fact, be true 
always that a design that results in partial confounding between some 
effects and interactions will yield less information per plot, as meas- 
ured above, than a design that does not have such partial confounding. 
For this reason and for those given above, fractional designs other than 
of type 1 in p” for the p" system are not advantageous, though in a 
given situation one of them may be resorted to. 


21.6 WEIGHING DESIGNS 


Considerable attention has been given in recent years (Hotelling,* 
Mood, Plackett and Burman,“ Kempthorne,’ Kishen °) to a problem 
originally considered by Yates.’ The problem is that of weighing a 
number of small objects by a balance, the errors of operation, reading, 
and balancing of which are important relative to the magnitudes of the 
weights of the objects. It is not our purpose here to describe this work 
in detail, but it is illustrative of the general: process in the design of 
experiments. 

If we put objects a, b, ¢, for instance, in the right-hand pan of the. 
balance and enough known weights in the left-hand pan to balance the 
machine, then the observation Yate may be expressed in the form 


Vae = p A BC Hente (26) 


where u is the bias of the machine; A, B, and 0 are the true weights, 
and eae is the error. In general, a set of weighings may be written in 


the form of a matrix 
1:0. 1:010 


0. 3150.11 
etc. 


424 THE GENERAL CASE OF FRACTIONAL REPLICATION 


of which the first column refers to a, the second to b, and so on, and the 
first row to the first weighing, etc. In the first weighing, then, objects 
a and c are weighed; in the second b, d, and e; and so on. If we add a 
column of 1’s at the beginning we have a matrix X, say, and, if we de- 
note the » observations by a column matrix y consisting of » numbers, 
the observations may be written 


y=Xate — (27) 
where 


Qh RF 


and e is a column matrix of the errors of weighing. From Chapter 6, 
we know that the estimates @ are given by 
, A = S7X'y 
where (28) 
S-XX 


and the variance-covariance matrix of the estimates is (8102. 

The weighing problem, therefore, reduces to the consideration of the 
matrix S^! and particular properties of it. For our purposes it is, 
however, simpler to redefine A to be equal to p — WA — WB — C, 
etc., and to write 4A, WB, ete., for A, B, ete. With this redefinition, 
the elements of a row of the matrix are plus unity if the corresponding 
object is placed on the right-hand side of the balance and minus unit y 
if not used in the particular weighing. With the matrix so defined and 

the equation 4 
y= Xat+e 


a will now consist of the new: and half the true weights. The true 
weights are then estimated by 


28^! X'y 
with variance 4(S~')o?. The problem is, therefore, to maximize some 
chosen property of the matrix 8 l. 
In general, the property we would maximize would be the determi- 


nant of S, and we would then obtain minimum generalized variance of 
the estimates (see Cramér? for instance). This is done very simply 
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under certain conditions, for we note that the matrix X consists of rows 
each containing plus or minus unity. If there are n weighings in all, 
i.e.) n rows in the matrix X, and p objects to be weighed so that X has 
(p + 1) columns, the columns of the matrix ean be represented as vec- 
tors in n-dimensional space. Furthermore, the vectors are all of the 
same length because each term in each column is plus or minus unity. 
The determinant of S is the volume of the parallelepiped formed by the 
(p + 1) vectors in the n-dimensional space, and clearly the volume of 
the parallelepiped is a maximum when the (p + 1) vectors are mutually 
orthogonal. The problem of evolving weighing designs reduces to the 
enumeration of matrices of the desired type if they exist. Otherwise 
one must follow trial and error methods, or rather special devices (see 
Mood *). Matrices that have the desired property are known as Hada- 
mard matrices, and the reader may consult Plackett and Burman's 
paper * for a review of the subject and a listing of matrices. If a matrix 
X with the desired property exists, then X’X is equal to n times the 
r-by-r unit matrix, so that the estimates of A, B, etc., will be subject 


4 2s m P 
to a variance equal to — . This is the minimum value of the variance 
n 
of any weight that can be obtained with any weighing design of the 
type we are discussing. These estimates are, in this case, : X'y, which 


is very simply computed. Because we have considered only the case 
when the objects are put in the right-hand pan and the weights in the 
left-hand pan, the problem is known very appropriately as the spring 
balance problem. 

The other branch of the problem is known as the chemical balance 
problem, in which weights and objects can be put in either pan, and the 
procedure will be to put a set of the objects in the right-hand pan and 
the remainder in the left-hand pan and add known weights to one pan 
or the other, as the case may be, to bring the pointer to the zero mark. 
Clearly the same formulation as above holds; if we replace 144 by 4, 
the same design considerations hold; and the minimum variance that 
can be achieved is /n. i 

We may note, in conclusion, that the full set of 2” factorial combina- 
tions gives a design with the required property, as does any fractionally 
replicated design that keeps main effects unconfounded with each other. 

We may also note that we have shown, in a roundabout fashion, that, 
if the experimenter's concern is to estimate effects and interactions, the 
full set of factorial combinations, or a suitably chosen fractional repli- 


cate, is optimum for the purpose. 


Ld THE GENERAL CASE OF FRACTIONAL REPLICATION 


21.7 AN EXAMPLE OF THE USE OF FRACTIONAL 
REPLICATION 


For a more complete description of the problem, the reader may re- 
fer to Tischer and Kempthorne.” In brief, the problem was to deter- 
mine the effect of various factors on the readings given by a machine 
called the Adams consistometer, which is used to give a measure of the 
consistency of some types of canned food. The investigation was made 
because standards are being set up for the consistency of some canned 
foods, and the Adams consistometer was thought likely to be generally 
adopted for the purpose. The particular factors were chosen because 
they were thought to be of possible importance in routine use of the 
machine. The basic idea of the machine is that the food is emptied 
into a truncated cone which is in contact with a flat metal sheet, the 
container is raised, and the spread of the food measured. The 6 factors 
that were thought to have possible importance were: 


(a) Rate of lifting of the cone. 

(b) Temperature of material. 

(d) Time allowed for spreading. 

(©) Methods of cleaning the apparatus. 
(/) Angle of the cone. 

(g) Surface of the cone. ‘ 


factors were independent in their actions and that there were no inter- 
actions, but, on common sense grounds, high-order interactions were 
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likely to be trivial. It was, therefore, uatural to consider the use of a 
fractionally replicated design. A 36 replicate based on the identity 


I = ABCD*E = CD*E*F*G? = ABC*DF*°G? = A 


was used, and the 243 treatment combinations were divided into 9 
blocks of 27, by confounding the 4 comparisons each with 2 degrees of 
freedom which have as one name 


AB*F?G, BCDF, ACDG, ABC*'D'FG 


It may be verified that, in this way, no 2-factor interaction is confounded, 
Thus, if A B?F*G is confounded, then so are AC?DE*FG*, BC'DEF'G, 
ACD, ARC, AC, BCD*G, AEG, BEF also con- 
founded. A group of 27 combinations constituted a day's work, and 
within each day the 27 were arranged in random order, The intrablock 
subgroup for the design consists of the 27 combinations shown in Table 
21.1. 
Taste 21.1 


1 


MH OCOPR ON NOONNONE HE NE NNHE EHH OSCOR 
0 WEK CON ENE NRK OCONHK CONE NK OONO ST 
St tee KOR ON HR OCONONNEKKOONN HK NEKO 
CH CH NN OH NON OH ENON HK ENE NSCOR NO HR 
CONN OKR HER HK OOK ONNE NNN KK NRK OOO 
—-wwoo-oo-o-cewwowow-mooo--w»-uwo't 
DWH KH NHK OON MEH NH OOCOCONNE RE ee 
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A condensed analysis of variance is given in Table 21.2. Actually, 


TABLE 21.2 ANALYSIS OF VARIANCE OF EXAMPLE 


Sum of Mean 
df Squares Square F 

Blocks / 8 38.98 
Main effects 

A 2 6.33 3.16 

B 2 577.93 288.96 184 

C 2 6688.31 3344.16 2130 

D 2 98.40 49.20 3.31 

E 2 1.05 0.52 <1 

F 2 17.28 8.64 5.5 

G 2 16.79 8.40 5.3 
2-factor interactions 84 141.80 1.69 1: 
Error 136 213.46 1.57 

"Total 242 7800.33 


the sets of 4 degrees of freedom for the 21 interactions were separated, 
and only 2 of them, of b and c, and of f and g, were significant at the 
5 percent level. "There is, therefore, very little evidence of interactions, 
except that an interaction of b and c would be expected on general con- 
siderations. In addition, repeated observations, with all the other fac- 
tors kept constant, were made on the 3 types of material. The mean 
square between repeated observations was 1.46, so that there is also no 
evidence of high-order interactions. This mean square was not entirely 
homogeneous, but the effect, of the heterogeneity on interpretation based 
on the analysis of variance was thought to be small. We shall not give 
the estimates of the effects of the factors, because they are of no inter- 
est in the present context, nor shall we discuss some other aspects of 
the experimental results. 

This example is disappointing in the sense that it did not bring to 
light any interactions, and &o, for this problem, the effects of each of the 
factors could have been obtained by varying each factor independently. 
The knowledge that even 2-factor interactions are unimportant over the 
ranges of the factors considered, is, however, valuable and could not 
have been obtained without a design of the factorial type. Further- 
more, the accuracy with which the effects are estimated by this design 
would have necessitated about 1700 (7 X 243) observations, if the fac- 
tors had been varied one at a time. 

The precision for estimates of effects given by the actual experiment 
is unnecessarily high, but a minimum of about 30 observations per fac- 
tor would have been necessary with 7 one-factor experiments so that 
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the fractional design is in no way inferior to the other type, and gives 
additional information which was desired. r 
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CHAPTER 22 


Quasifactorial or Lattice 


and Incomplete Block Designs 


221 INTRODUCTION 


The problem we shall be discussing in this and the following chapters 
is the comparison of a number of treatments, which are not related in a 
special way as are a factorial set of treatments, with blocks the size of 
which is less than the number of treatments. For example, plant breed- 
ers are frequently in the position of having to compare, say, 100 varie- 
ties or first crosses of inbred lines. In earlier chapters we discussed the 
effect of size of block on the variance of treatment comparisons and de- 
scribed Fairfield Smith’s empirical law according to which the within- 
block variance increases to a varying degree, depending on the nature 
of the experimental material, with increasing number of experimental 
units per block. We also obtained a view of the effect on the sensitivity 
of tests of hypotheses of the size of the experimental. error variance. 
As a result of these considerations, we devoted some chapters to a dis- 
cussion of confounding, a device by which the size of block within which 
comparisons are made may be reduced, with resulting gain in precision 
on the comparisons of interest to the experimenter, and at the expense 
of information on comparisons that the experimenter thinks to be un- 
important. The problem we shall discuss is therefore an important one. 

The size of block that should be achieved depends markedly on the 
experimental material and the cost of achieving this size. For example, 
in nutritional experiments on young sheep, it might well be advisable 
to make comparisons within pairs, because pairs of lambs are f requently 
obtained, and the pair of lambs, although not genetically identical (un- 
less the twins are identical), will be the result of the same cross and will 
have been subjected to the same intrauterine environment as well as, 
presumably, similar postnatal environments. They may be expected 
then to be much more similar than a pair of lambs taken at random 


from a flock. In an experiment on young cattle, the same considera- 
430 
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tions hold, and, in recent years, it has been found that the frequency of 
identical twins-is sufficiently high to make the consideration of the use 
of blocks of two identical twins important. The gain in accuracy that 
may be expected by the use of twins in these cases, for example, over 
the use of larger blocks may be estimated from experimental data in 
which twins have been used, as we shall indicate later. 

In the case of field plot experiments, the size of plot is usually, though 
by no means always, fairly well determined by experimental and agro- 
nomic techniques, and. the’ experimenter usually aims toward a block 
size of less than 12 plots: In some circumstances this is impossible and 
in other cases possibly not worth while. If this arbitrary rule is ac- 
cepted, and we wish to compare 100 varieties, we might use for example 
10 blocks of 10 plots for each replicate. If this is done, it is obvious we 
can make up 99 treatment comparisons in a replicate to consist of 90 
comparisons which are entirely comparisons within blocks and 9 com- 
parisons which are between blocks. These between-block comparisons 
will be less accurate than the within-bleck comparisons, for they will 
be subject to an error based on the failure of blocks of 10 plots treated 
alike to yield the same results. The blocks could be made up so badly 
that the between-block error will not be greater than the within-block 
error, but the former error will not usually be less than the latter. In 
general, if blocks are made up on the basis of contiguity of plots or on 
the basis of prior information about the fertility of the plots, the be- 
tween-block error will be considerably greater than the within-block 
error. Furthermore, more than on replicate will be necessary in order 
that the experimental error may be estimated. It is therefore appro- 
priate to consider how the replicates should differ from each other, in 
order that the information on all possible comparisons shall be as large 
as possible. 

There are two main groups of designs which may be distinguished: 


1. In which a correspondence may be established between the treat- 
ments and the treatment combinations of a factorial set, and, when the 
treatments are renamed according to this correspondence, the methods 
for factorial experiments we have discussed may be used. Designs of 
this group are known as quasifactorial or lattice designs. ` 

2. In which, although it may be possible to set up the sort of corre- 
spondence mentioned in 1, the correspondence is of little or no help in 
devising the design or simplifying the analysis. This group of designs 
will be denoted by the term incomplete block designs. 


It should be pointed out that the distinction we make is not a hard and 
fast one but is of value in describing the designs. Under most circum- 
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stances, the designs that will be discussed under 1, which will be ob- 
tained by the use of a factorial correspondence, could have been ob- 
tained in other ways. Their derivation from a corresponding factorial 
model is, however, quite straightforward, and it would be unnecessarily 
tedious not to adopt this procedure. The next few chapters will dea! 
with the first group of designs and later chapters with the second group. 
This order has the possible virtue of conforming largely to the chrono- 
logical order of the development of the designs. 


22.2 THE SIMPLEST QUASIFACTORIAL DESIGN 


With perhaps a little risk of another design being regarded as the 
simplest, we consider the testing of 4 treatments 1, t2, ta, t4 in blocks of 
2 experimental units. Such a design might well be of value in a study 
on the nutrition of young sheep as mentioned previously. 

The first step is to set up a correspondence between the 4 treatments 
and the treatment combinations of 2 factors, a, b, say, each at 2 levels, 
as in Table 22.1. 


TABLE 22.1 
Quasifactorial 
Treatment Combination 
h (1) 
ty a 
ts b 
64 ab 


i In Chapter 14 we discussed the arrangement of 2 factors at 2 levels 
in blocks of 2 plots. There are, in fact, 3 possible arrangements: 


Confounding Blocks 


A (1), b and a, ab 
B (1), a and b, ab 
AB (1), ab and a, b 


and we may use these arrangements for the 4 treatments so that we 
have 3 types of replicate (Figure 25). 


Replicate I Replicate II Replicate III 


hot 
tz ds 


FIGURE 25. 
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Now let us make r repetitions of each of these replicates, so that we 
have 3r replicates in all, and consider the estimation of the effects and 
interactions. This is quite straightforward, namely, that we estimate 
A from the replicates of types II and III, B from the replicates of types 
I and III, and AB from the replicates of types I and II. Each effect 
and the interaction will be estimated with a variance of 9% 27, where 
c? is the variance within blocks of 2 units. 

Our object in setting up the experiment in the first instance was to 
estimate the differences among the treatments tı, t2, t3, and t4. If we 
denote the yields of (1), a, b, and ab by the same symbols, we have 


(1) = u — 3A — 1B + 3AB 
a = u + 3A — 3B — AB 
b = u 247 4B — 3AB 
ab = p + 3A + $B + 34B 
Any comparison among the 4 treatments is expressible in terms of A, 
B, and AB, for instance, 
4) — tz = (1) - a = —A-c- AB 
ty + t —25 = (1) +a — 2b = A — 2B + AB 
and so on. We have obtained estimates of A, B, and AB, so that we 


can substitute these estimates to obtain the estimate of the treatment 
comparison. Thus: 


(h % me Sd Sp AB. 
(à 2 t) = -B + 4B 
(ei S f. = -A-B 


and any other comparison may be computed from these differences. 
Now let us examine the variances of these differences. Each of the 


estimates A, B, and AB has a variance of o”/2r, and the estimates are 
independent, so that we have 
var (l =) = 


var (t 2 %) = 


var (I = ts) = 


3[9 21% 21% 
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It is easily verified that the estimate of the difference between any 2 
treatments has a variance of c?/r. 

This may be compared with the variance that would have held if we 
had used blocks of 4 plots, for then, with the total of 3r replicates, any 
treatment difference would have a variance of 20?/3r. In the latter 
case, however, the o” refers to the variance within blocks of 4 plots and 
should be written c?,, whereas, in the former case, it should be written 
as 022. In general, we know that c?, will be greater than c^», and, if 
c?, is greater than 3407s, the confounded design will have resulted in a 
lower variance for the estimate of a treatment difference. If the reduc- 
tion from blocks of 4 plots to blocks of 2 plots had not reduced the ex- 
perimental error variance, the quasifaetorial design would have given 
“(= i + zs) of the information given by the design with no con- 
3 URAA 
founding. This factor of 2/3 is known as the efficiency factor of the 
particular incomplete block design. 

The analysis of variance of the yields of the 3r replicates has the 
structure shown in Table 22.2. 


TABLE 22.2 
Expectation of 
Due to df Mean Square 
Replicates 3r — 1 
Blocks 3r 
A 1 
B 1 
AB 1 
Error (intrablock) 6r -3 e? 
Total 12r — 1 


So far we have utilized only information given by comparisons within 
blocks. 


To utilize the between-block information, we note that the block sum 
of squares may be partitioned in the following way: 


A 1 
B 1 
AB 1 
A X reps I r 
B X reps II r 
AB X reps III r 
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Replicates of type I, therefore, contain some information on the A 
effect, and, similarly, replicates of type II on the B effect, and replicates 
of type III on the AB effect. An important question is then the com- 
bination of this information with the information given by within-block 
comparisons, and the process by which this is done is known as the re- 
covery of interblock information. 

The basis of this method is as follows. It is assumed that the yield 
of a plot is made up of a quantity u constant for all plots, a quantity r 
constant for all plots of the same replicate, a quantity ¢ due to the par- 
ticular treatment, a quantity b common to all the plots of the same 
block, and a quantity e varying from plot to plot, thus, 


y=utrt+titbre 


There are, of course, a number of quantities r equal to the number of 
replicates, of quantities f equal to the number of treatments, and so on. 
The quantities u, 7, t are assumed to be fixed unknown parameters, 
whereas the quantities b are assumed to be uncorrelated with mean of 
zero and variance o°» and the quantities e to be uncorrelated with each 
other and with the b’s with a mean of zero and variance c?. The as- 
sumptions about the e’s follow from the assumption of additivity, and 
the assumptions about the b's follow from the assumed additivity of 
block effects, and the fact that groups of treatments specified to be to- 
gether in a block are assigned to a block at random (cf. Chapter 8). à 

Consider the two possible estimates of the A effect. The estimate 
from a replicate in which it is unconfounded will be a within-block esti- 
mate and will have a variance of o°. For a replicate in which A is con- 
founded, i.e., of the form 


where the 
Block 1 number in the 

plot is the plot 
Block 2 


number 


the estimate of A is 
N — Ya 0 
which is equal to A plus an error of 
3 201 + 252 — êi — e + ea + e) 


436 — QUASIFACTORIAL AND INCOMPLETE BLOCK DESIGNS 


The estimate, therefore, has a variance of 
c? + 207, 


Now we noted in the early chapters, that, if æ1 is an estimate of a 
parameter u, say, with variance 921, and 2 is an uncorrelated estimate 
of » with variance c?», the best combined estimate of u is 


which has a variance of 


Applying this rule to the present situation, we have an estimate, say, 
Ay of the effect of A from replicates of type I with variance (c? + 207,)/r, 
and from replicates of type II and type III we have estimates An and 
Ayn each with variance 6 /r. The best estimate of the A effect is then 


T yt TEHA E 
8 


TT 
02 + 202% "* E 1 E 
which may be written 
W'Ai Wan + WAmm 


W' + 2W 
where 
j 1 r 
bad rr pF 
'The variance of this estimate is 
1 
r(W' + 2W) 


In the above we assume that we know o° and c? + 20% whereas in a 
practical situation we shall not. The procedure that is followed is to 
obtain estimates d? and (o? + 29%, say, and to use, as weights, 
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1 1 


2 "A 


1 w 
c? + 2025 92 


We shall use capital W, W’ for the true weights, and w, w' for estimated 
weights throughout. This procedure is an approximation, and the va- 
lidity of the approximation will be examined later. 


Now, 
W'Ar+ WAn + WAm 1 
SS ee 
W'4-2W LAE u + Ani) 
o e 
Iw + 2) I n — An 
or 
A= Ar + Ac 


where A is the best estimate of the effect A, Ar is the estimate of the 
effect A obtained from the whole of the 3r replicates, and Ac is an ad- 


justment. Similarly, 
B = Br t Bc* 


where 


N N. 
Bo ) (-I + 251 — Br) 


730 + 2W 
and b. 
AB = ABr + ABc 
W'—W 
3(W' + 2W) 
Considering the yield of any one treatment, say, 4 which is the con- 
trol (1), and is given by - 


(1) = u — 44 - }B + A 


where 


ABc (—AB, — AB + 24 But) 


we find, on inserting the values for A, B, and AB, that 
(D - }Ar — 4Br + }ABr — 4c — 150 + Ale 
or, using the observed mean for A, 
Í, = mean yield of t in whole experiment— 34c — $Be + 1ABc 


Similarly, the yields of tz, (a, and 4, may be obtained by applying ad- 
justments to their mean yields over the whole of the experiment. 
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We may now consider the accuracy of treatment comparisons. The 
estimates of the possible comparisons of two treatments are: 

(à S t) = -Â + AB 

(1 = ts) = -Ê + ÁB 

(1 = %) = -A-B 

( 2 te) A 

( = 4) = —B- AB 

(a 2 t) = ZO 


Now the variances of A, Ê, and AB are each 1/r(W’ + 2W), and they 
are uncorrelated, and so the variance of each treatment difference is 
2/r(W' + 2W). If randomized blocks of 4 plots had been used, the 
variance of each treatment difference would have been 2/37. The 


1/1 2 
variance c?, is equal to He + x) for of the 3 degrees of freedom 


in a replicate, supposing there were no treatment effects, one has a 
variance of 1/W’ and two a variance of 1/W. The variance of each 
treatment comparison with blocks of 4 plots would then have been 


2074 2c =) 
„5 
Zy 9rNWW' W 


The relative efficiency of the quasifactorial design is defined to be 


1 variance of a treatment difference with complete 
randomized blocks 


Average variance of a treatment difference in the experiment 


In this case, the relative efficiency is 


s) 1 ) (20642) . ue 
or\w | W// rNW' + ow Or r 


The ratio z is positive and less than or equal to unity, under most cir- 

cumstances, for it equals ( + 26?,). The efficiency then has a mini- 

mum value of unity or 100 percent when W’ = W, and under all other 

possible circumstances is greater than 100 percent. If W’ is not much 

less than W, the efficiency will be near 100 percent, as would be expected 
1f 1 


intuitively, for then “|= (= - =) is close to zero, and there 
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is little variation between blocks additional to that within blocks. As 
we have noted before in other connections (ef. Chapter 19), the variance 
between blocks could be less than the variance within blocks on the 
same basis, though this should not happen often, if competition is 
eliminated. 


222.1 The Estimation of the Weights W and W” 

The main problem remaining for this simple example of a lattice de- 
sign is the estimation of the weights W and W'. We have already 
stated that the expectation of the usual mean square (E, say) which is 
called the intrablock mean square is o°, so that W may be estimated by 
w = 1/E. 

Now consider the estimation of W' = 1/( % + 20%). If we consider 
the estimate of the A effect in those replicates in which it is confounded, 
we note that the estimate in each replicate has a variance of 02 + 20r 
and so we may take the mean square between these r estimates, and this 
mean square with (r — 1) degrees of ireedom will have an expectation 
of c? + 20°». . Similarly, the mean square of the estimates of B between 
the replicates in which it is confounded gives an estimate of ce? + 2075 
based on (r — 1) degrees of freedom. The variation of AB also gives 
an estimate based on (r — 1) degrees of freedom. Finally, consider the 


quantities: 24 = Aun 
— B + 2By — Bur 
ABI — AB + 2ABm 
The first, for example, may be expressed in terms of the block errors 
and within-block errors, thus, 
: [2 (sum of rb's — sum of rb's) + (sum of 2re's — sum of 2re's) 
— 4(sum of 2re's — sum of 2re's) — 4(sum of 2re's — sum of 2re’s)] 


The expectation of its square is then 


ä - E: (8re?, + 6ra?) 
$ 


1 
3 [ses ＋ 0 (2r +2r + 1 


The expectation then of 


s (2A; — Au — Am)? 


is equal to 
e +4 
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This is also the expectation of 


T Y. 
5 + 2By — Bu)? and of a — ABI + 24 BI)? 


The complete analysis of variance for the experiment may then be 
written as in Table 22.3. 


TABLE 22.3 ANALYSIS OF VARIANCE FOR BALANCED 2? LATTICE DESIGN 


Expectation Observed 
of Mean Mean 


Due to df Square Square 
Replicates 3r - 1 
Between blocks 
A X reps I 
B X reps II 3(r — 1) a? + 20%, By 
C X reps III 
B 
241 — An — Am 
—Bi + 251 — Bin 3 o + 3% 32 
—ABi - AE + 2ABm 
Treatments 
A 
B 3 
AB 
Intrablock error 3(2r — 1) 02 E 


"Total 12r — 1 


The expectation of B, the pooled between-block mean square, is 
equal to 


3(r — D? + 2% + 3(0? + fo? 
- 
7 3r. 


We may, therefore, estimate c? by E, and o? + 20°, by 


Geers) 


and we may use the reciprocals of these as estimates of W and W’, re- 
spectively. If r were large, say, above 5, it would be nearly as satisfac- 
tory to use 1/B, as an estimate of W’, 

An examination will be made in a later chapter of the loss in efficiency 
due to inaccuracies in the weights. In the case we have examined, the 
estimation of the relative weights with a small number of replicates 
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(say, less than 4) would be so inaccurate as to render the procedure of 
utilization of the interblock information unsatisfactory. Our purpose, 
however, is to illustrate the process. 


22.3 TYPES OF LATTICE DESIGN 


The general theory of lattice designs will be given in the next chapter, 
and we will conclude the present chapter with an elementary discus- 
sion of the types of lattice design and incomplete block designs. In 
this section we shall describe types of lattice design. 

We have already given the basic property of lattice designs, that they 
are based on a factorial correspondence. In the first place, we may clas- 
sify designs according to the number of restrictions imposed in the ran- 
domization. For the example discussed above, the randomization 
within a replicate is restricted in one way: namely, by blocks. The pro- 
cedure in setting up an actual experiment is to obtain the groups of 
treatments that are to lie in a block, to allocate these groups to blocks 
at random, and to randomize the position of the treatments within the 
block. The only restriction is then that the placement of treatment 
combinations is restricted so that they occur in specified blocks. These 
designs will be referred to as lattice designs in conformity with the 
literature. 

The Latin square principle may also be used, resulting in a design 
with two restrictions. Groups of treatment combinations are specified 
that must occupy rows of plots, and other groups are specified that must 
occupy columns. For example, consider the pattern in Figure 26 for 
2 replicates of 9 treatments. 


FIGURE 26. 


The squares may be interpreted as a 2-way classification of the ex- 
perimental units of each replicate: If the units are field plots, Figure 26 
would be the pattern on the ground, if the 2-way classification of plots 
is based on contiguity. The classification will always be referred to as 
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rows and columns as though the experiment were a field experiment. 
In this pattern each treatment occurs with any other treatment either 
once in a row or once in a column. Consider the quantity 


T; — (14-2 ＋ Bu ＋ (1 d- 4 - Z)u ＋ (1 3- 5 4- 9): ＋ (13-6 4- 8i 


where (1 + 2 + 3) equals the total of the yield of treatments 1, 2, 
and 3 in replicate II, and so on. This sum contains all the row and col- 
umn effects of each square, and, if the yield of any one plot is regarded 
as made up of a replicate effect, a row effect, a column effect, a treat- 
ment effect, and a within row and column error, the above quantity 
is equal to (34 + 9t.) plus a certain linear function of the errors plus 
the replicate, row, and column effects in equal proportions, where /; is 
the effect of treatment 1 and /. is the mean treatment effect. Similarly, 


72 — (L ＋ 2-3) ＋ (2 4 5 ＋ 8i + (2-- 4 T 9)r + (2-6 - 71 


is equal to (345 + 9t.) plus a linear function of the errors, plus the same 
linear function of the replicate, row, and column effects. The quantity 


a(T; — T2) 


is then an estimate of (f — tz) with a variance depending only on the 
variance of the within-row-and-column errors. Under the same circum- 
stances that the Latin square of side k is useful in comparing / treat- 
ments, because the removal of row and column differences produces a 
reduction in the error variance to which treatment differences are sub- 
ject, the above type of lattice design will be effective for comparing the 
corresponding number of treatments. Such designs are known as lat- 
tice square designs. 

This hierarchy of designs may, in a sense, be continued, for it is pos- 
sible to specify the groups of treatment combinations that are to be 
together in a block and then to place a double restriction on the alloca- 
tion of the groups to the blocks. An example of this type will be dis- 
cussed in a later chapter. This design may be regarded as being sub- 
ject to three restrictions on the randomization of the position of the 
treatment combinations. 

Within the set of designs with one restriction, we may classify designs 
according to the number of treatments relative to the block size and 
to the number of different confoundings used. If the number of treat- 
ments is the square of the size of block, the designs are known as 2-di- 
mensional. In the example we discussed for 4 treatments, 3 different 
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confoundings were used, and these were all the possible ones. If 2 dif- 
ferent confoundings are used, the design is known as a simple lattice, 
the name being used also if the basic 2 replicates are repeated any num- 
ber of times. If 3 different confoundings are used, the design is known 
as a triple lattice. With k? treatments, k being a prime number or a 
power of a prime number, up to (k + 1) different confoundings may be 
used, and, if a complete set of (k + 1) different confoundings is used, 
the design is known as a completely balanced lattice. If k is not a prime 
number or a power of a prime, in general, only 3 different confoundings 
are possible, being based on the rows, columns, and letters of a % N 
Latin square. In the case of k equal to 12, four different confoundings 
are possible. ; 

With A? treatments in blocks of k plots, the design is known as a 
3-dimensional lattice. Such designs with 3 different confoundings exist 
for all values of F. If more than 3 different confoundings are desired, 
the position is a little more complex. If k is a prime number or a power 
of a prime number, the examination of possibilities is relatively straight- 
forward and will be given in the following chapter. 

This process may be extended indefinitely, and a few examples will 
be given in the following chapter. For instance, the testing of 32 (= 25) 
treatments in blocks of 4 (= 22) plots may be examined as a quasifac- 
torial design. , 

Within the set of designs with 2 restrictions which may be used for 
k? treatments in k X k squares, the situation is as follows. If k is a 
prime number or a power of a prime number, there are (k + 1) orthogo- 
nal groupings into k groups of k treatments, and it is possible to arrange 
the treatment combinations in (k + 1) replicates, so that each orthogo- 
nal grouping is confounded once with rows and once with columns over 
the set of (k +1) replicates. This design is known as a completely 
balanced lattice square. If each orthogonal grouping is confounded 


9 replicates, the design 


k 
once with rows or once with columns in ( 


is known as a semibalanced lattice square. A lattice square design 
other than these may be termed an unbalanced lattice square. If k is 
not a prime number or a power of a prime number, in general, only 3 
orthogonal groupings into k groups of k treatments are possible (except 
k = 12 as far as is known), and only 3 basic replicates are possible. 

There is another type of design for k(k + 1) treatments, which is 
somewhat similar to lattice designs and is known as rectangular lattices. 
The number of replicates clearly possible is a multiple of 2 or 3 basic 
replicates. 
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224 TYPES OF INCOMPLETE BLOCK DESIGN 


The simplest type of incomplete block design for ¢ treatments is that 
in which there is a block for each possible pair of treatments. This is, 
of course, possible with any number of treatments, but the number of 
blocks is ¿(t — 1)/2, and the number of replicates is (f — 1), which is 
often inordinately large. This is the simplest type of balanced incom- 
plete block design which is defined to consist of a number, say, 7 repli- 
cates of each treatment, in blocks of, say, k plots, the balanced property 
being that each possible pair of treatments occurs together in the same 
number of blocks (always denoted by A). The example of a lattice de- 
sign that we used has this property and may therefore be regarded in 
either way. Such designs are, however, with a reasonable number of 
replicates, often unavailable, and recourse is then made to partially 
balanced incomplete blocks. The definition of these is somewhat 
lengthy and is postponed to the appropriate chapter. In addition, 
there are incomplete block designs with a double restriction, known as 
Youden squares. 
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CHAPTERS 


Lattice Designs 


'The theory on which this chapter will be based is that of Chapter 17 
on the general prime-power factorial system. In that chapter we noted 
that the cases of p equal to a prime and p equal to a power of a prime 
were identical if the Galois field of p elements was used for the represen- 
tation. We shall here devote our attention mainly to the case when p 
is a prime number, as the other case may be developed in the same 
fashion. For the rest of this chapter, therefore, p will be used to de- 
note a prime number, and, except for the last section, we shall be dis- 
cussing the case of p” treatments. 


23.1 TYPES OF LATTICE DESIGNS 


23.1.1 2-Dimensional Lattices 

These are designs for p? treatments in blocks of p plots, and we may 
represent the p° treatments by the combinations of 2 factors, say, a and 
b, each at p levels, so that the quasifactorial name of a treatment isa 
set of 2 numbers (ij), both ? and j taking on the values 0 to (p — 1). 
We know that there are (p + 1) possible orthogonal groupings which 
we may represent by the symbols A, B, AB, AB?, +, AB?-, If we 
are using a simple lattice, we may confound A in one replicate and B 
in the other. There is, as we shall see later, no point in choosing any 
other set of 2 groupings. This is, in any case, obvious since our corre- 
spondence between the treatments and the quasifactorial treatment 
combinations is entirely formal and arbitrary. If 3 orthogonal group- 
ings are to be used, we may choose A, B, and AB in our factorial rep- 
resentation, to give us a triple lattice. A quadruple lattice is given by 
4 groupings, say, A, B, AB, and AB?. If we use a balanced lattice with 
(p + 1) replicates, we would confound each of A, B, AB, AB’, «++, 
A B?-' in one of the replicates. 
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23.1.2 3-Dimensional Lattices 


In this case, we have p? treatments arranged in p? blocks of p plots. 
We may represent the treatments by the combinations resulting from 
3 factors each with p levels: namely, 0, 1, 2, +++, p — 1. In order to 
have p? blocks of p plots, we must confound 2 effects or interactions 
and their generalized interactions. Thus, with p = 3, there are 13 pos- 
sible systems of confounding. In general, there are (p? + p + 1) dif- 
ferent schemes of confounding. 

It may be noted that, if it is desired that each effect or in- 
teraction be unconfounded in at least one of the replicates used, 
at least 3 replicates are necessary. A set of 3 replicates may be 
specified as follows: 


Replicate Confound 
I A, B, AB, AB?, . , AB? 
Il A, C, AC, 402, . ., AC?! 
III B, C, BC, BC*, . . ., BCI 


In this case, which is the one described by Vates, all main effects are 
confounded in 2 out of the 3 replicates, all 2-factor interactions in 1 of 
the 3 replicates, and the 3-factor interactions are completely uncon- 
founded. 

If 4 replicates are used for the case of 3°, we may add to the above 


Replicate IV: Confound AB, AC, BC?, AB?C? 


The usual practice with 6 replicates is to repeat replicates I, IT, and III 
above. It will be seen later, however, that a more efficient. design is ob- 
tained by using different schemes of confounding in each replicate. 


23.1.3 4-Dimensional Lattices 


In this case we have p* treatments to be TER in p* blocks of p 
plots. If 4 pseudofactors, a, b, c, d, are used to give the pseudofactorial 
treatment combinations, we may enumerate the possible schemes of 
confounding as in the 3-dimensional case. From Chapter 17 we know 
that there are (p* — 1)/(p — 1) possible schemes of confounding. With 
p = 3, there are 40 schemes of confounding, and they are specified in 
Table 23.1. The confounded effects and interactions will consist of 
those given in the table with all their possible products. 
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TABLE 23.1 SCHEMES OF CONFOUNDING FOR 3! SxsreM IN BLocks or 3 Prors 


-Generators of Set of Confounded Interactions 


Number Generators Number Generators 

1 A, B,C 21 B, AC?, AD 

2 A, B, D 22 B, AC?, AD? 
3 A, B, CD 23 AB, C, D 

4 A, B, CD? 24 AB, C, AD 

5 4, C, D 25 AB, C, AD' 

6 A, C, BD 26 AB, AC, D 

7 A, C, BD* 27 AB, AC, AD 

8 A, BC, D 28 AB, AC, AD? 
9 A, BC, BD 29 AB, 402, D 
10 A, BC, BD* 30 AB, AC?, AD 
11 A, BC, D 31 AB, AC?, AD? 
12 A, BC, BD 32 AB?, C, D 

13 A, BC, BD? 33 AB?, C, AD 
14 B, C, D 34 AB?, C, AD? 
15 B, C, AD 35 AB?, AC, D 
16 B, C, AD? 36 AB?, AC, AD 
17 B, AC, D 37 AB?, AC, AD* 
18 B, AC, AD 38 AB?, AC?, D 
19 B, AC, AD? 39 AB?, AC?, AD 
20 B, AC, D 40 AB?, AC?, AD 


23.1.4 5-Dimensional Lattices 

This case is possibly not of great practical value but is rather instruc- 
tive from the point of view of the analysis of variance and is, therefore, 
included. There are p? treatments, and it is desired to arrange them in 
blocks of p plots, for example, 32 treatments in blocks of 2 plots. At 
least 5 replicates will be desirable in order that each effect and interac- 
tion shall be unconfounded with blocks in one of the replicates. If the 
pseudofactors are denoted by a, b, c, d, e, we may confound 4 of the main 
effects and all their interactions in a replicate, giving 5 different repli- 
cates in all. 


23.2 THE GENERAL METHOD OF ANALYSIS 


In Chapter 17, we gave the expressions for effects and interactions in 
terms of the yields of the treatment combinations and for the yields of 
the treatment combinations in terms of the effects and interactions. 
This formalization is the basis of the analysis which will be described 
for the designs described above. It was seen in that chapter that the 
difference in yield of any 2 treatment combinations could be expressed 
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in terms of the effects and interactions. The general method of analysis 
will be then to obtain the best estimates of the effects and interactions. 
As we saw in the previous chapter, it is necessary, in order to do this, 
to know the relative weights to be assigned to estimates based on com- 
parisons within and between blocks. 

The yield of any plot is assumed to be made up of the following com- 


ponents: 


A general mean. 

A replicate effect, say, r. 

A treatment effect, say, t. 

An error common to all plots of the same block, say, 7, which has a 
mean of zero and a variance of 025. 

An error particular to the plot, say, e, which has a mean of zero and 
a variance of c?. 


The errors e and may, under the additive model, be taken to be un- 
correlated because of the randomization procedure used. The treat- 
ment effect is reparametrized in terms of effects and interactions for 
convenience of analysis. 


: cA 
To recapitulate for the p" system, there are ( i ) sets of (p — 1) 


degrees of freedom, and each set of (p — 1) degrees of freedom is given 
by the comparisons among p totals, each of (p^^!) treatment combina- 
tions. If the treatment combinations are denoted by (Ti, £o, 25, , 
Tn), where each z; runs from 0 to (p — 1), any set of p totals is given 
by the treatment combinations which satisfy 


a + ao +++++ antn = i mod p 


i taking the values 0, 1, 2, ..., (p — 1), and the o's also being in this 
range. The deviation of the mean of the combinations satisfying this 
relation from the general mean was denoted by A*'B**...; Denoting 
120 yield of the combination (a, , £n) by ls, «++, zay We found the re- 
ation 


less 1 Dau "E rate! Leber E «Fans 


ar 


: des disc 
where the summation is over the (? ) possible choices of the a’s 


and over r from 0 to (p — 1), with 


P : 
Drain esse + ei oa =1 if aX, + a ++ + Ann = r mod p 


= 0 otherwise 


ro — n 


a. 


"es 


6 
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Consider now the estimation of the quantities, 
ACB ce r = 0,1,2, ---, (p — 1) 


If the corresponding effect or interaction is unconfounded in a particu- 
lar replicate, the estimate of each of the quantities A*'B*' - from that 
replicate is the same function of the observed yields and will be subject 


2 
0 


21 1 
to a variance of —— = Any comparison 
p 


prt 
D),A™B™ „ with Dd, =0 


will have a variance of a 
(27) => 
p 


The quantity (Oe depends only on the comparison and not on the 
design, and so we may say that the variance of the estimate of any 
A™ B® , is / pi. Similarly, if che effect or interaction is con- 
founded with blocks in a replicate, the estimate of each quantity 
A™B™ ..., will be subject to a variance of 


1 


net 


(c? + ko») 


where k is the size of the block and is, of course, equal to some power 
of p. For the total of the plots for which Zajr; = r mod p will contain 
pu! different within-block errors, and k times the sum of p" /k block 
errors, there being p"! blocks which contain the plots that make up 
the total. The variance of the mean on a per-plot basis is then 


1 „ Like 


We now suppose that we know c? and (c? + Feed), and we may obtain 
the best estimate of any effect or interaction by weighting the estimate 
in each replicate by W = 1 os, if the effect or interaction is uncon- 
founded, and by W’ = 1/(s? + ke?) if it is confounded. We need be 
concerned only with relative weights obviously. 

It is not always necessary, computationally, to go through this pro- 
cedure of obtaining the best estimate of each effect and interaction. 
For, what is needed eventually is the best estimate of treatment com- 
parisons, and, although this may be obtained by estimates of the effects 
and interactions, in many cases a short-cut method may be used. Par- 
ticular cases will be illustrated below, together with examples of the 
estimation of W and W’. 
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23.3 THE ANALYSIS OF 2-DIMENSIONAL LATTICES 


We suppose that the 2 pseudofactors are a and b each with p levels, 
and that the effect A is confounded in one replicate I, and effect B in 
the second replicate II. Since A is confounded in replicate I and un- 
confounded in replicate II, any component of the A effect is best esti- 
mated by 


W'Ar--WAn 1 W'—W 
A = — —— --(A A ————_— (A1 — A 
WW 5 (art D + op Wy “At 11) 
M POS ay l 
Tta A I (1) 


where Ar, Arr, Ar are the component estimated in replicates I, IT, and 
both replicates, respectively, and W = 1/0, W’ = 1/( + po”). 
Similarly, the best estimate of any component of the B effect is 

Ww’ 


B=B yi dina i BI ＋ B 2 
= r+ oar am 1 + Bn) (2) 


whereas for any component of the interaction, say, AB, \ = 1, 2, . , 
(p 11 1); 
AB = AN (3) 


We now wish to combine these estimates of the effects and interac- 
tions to obtain the estimates of the yields of each treatment. The ex- 
pression for the yield of a treatment combination is 


w+ À 4 B4 AB (4) 


where the suitable components of A, D, and AB are used, and this 
equals 


W'—-Ww 
u + Ar + Bp -- AB — ^ 
T T + OW EY (41 — An) 


E gp A LOUP 
2(W’ + W) 


N 


(BI + Bn) (5) 


But u + Ar + Br + ABr is equal to the observed mean of the yield 
of the particular treatment, and so we have 


i = lij + Cai + Chj (6) 
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where 
fj; = the best estimate of the yield of treatment (ij) 
I; = the observed mean yield 
— [G5 — Oh = Oa 
— 16h COPS: M 
2074 W) I 1 n I A 
W- W CCo ( ＋ Cdn 7 COul 
6p = E Man 25 . 
bj XW + W) IN I Ju II 
and 


(i-)r = mean of treatments with a at level 7 in replicate I 
(- +); = mean of all treatments in replicate I 


and so on. 
Finally, it is necessary to consider the estimation of W and W'. The 


partition of the analysis of variance in Table 23.2 may be obtained. 


TABLE 23.2 STRUCTURE OF ANALYSIS OF VARIANCE FOR SIMPLE LATTICE 


Expectation of 
Due to df Mean Square 
Replicates 1 
Blocks eliminating treatments 2(p — 1) 02 ＋ 2 5 
Treatments ignoring blocks 52 — 1 
Error (intrablock) (p — 1}? La 
Total 2p —1 


The replicate and treatment sums of squares are obtained in the usual 
way. Of the 2(p — 1) degrees of freedom for blocks eliminating treat- 
ments, (p — 1) arise from the quantities (A1 — An), and (p — 1) from 
the quantities (Br — Bu). The quantity 

[G9 — C Gu + C 2nl 
is orthogonal to replicates and treatments and, expressed in terms of 
block errors and within-block errors, is equal to 


=} 1 =] 
* C ) — — (sum of all other r9] + 6 = ) (sum of pe's) 
p p p 


-1 
= Ja lsum of (p? — p)e’s) + (* " ) (eum of pe's) 


* 5 [sum of (p° — p)e's] 
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'The expectation of the square is then 
* -1 
ar (e 
p p 
and, summing over the values of 7, we get 


— 1 
(p De + (=) a 
The expectation then of 


ple - (Ci - Ga + CP 
which is the sum of squares for the comparisons (Ay — Arr), is 
(p — 1) G 750 
Similarly, the expectation of the sum of squares for (By — Bir) 


2 L- 0 enn — Cul 
is 


(n —3T) (# "A 50 


These two quantities together make up the sum of squares for blocks 
eliminating treatments, and their mean square, say, B, has an expectation 


of e! + Fos 


The sum of squares for intrablock error may be obtained by subtrac- 
tion. The expectation of the mean square E, say, is G, as may be veri- 
fied, for example, by noting that the total of (p — 1)? degrees of free- 
dom consist of (p — 1) degrees of freedom for the interaction of AB^ 
with replicates, \ = 1, 2, „ p — I. 

We may then estimate W and W' by 


n 1 

w = =: vs 
2B—E 

. — 
and — — —— 
2(W' -- W) 
to work in totals over the two replicates. With this method we interpret 
(i-), for instance, as the total over j for replicate I, and use a multiplier 


d s E—B 
is estimated by "4 Computationally, it is simpler 
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Also, we need not 


1 E— 
for the adjustment of R N 2.16, 
p 
bother with the terms (--)r and (- -)r, which cancel out in the summa- 


tion. 


23.3.1 Repetition of the Simple Lattice ` 

If the above simple lattice is repeated r/2 times, the estimation of 
the vields of each treatment, combination proceeds in exactly the same 
way, except that the quantities (I.) , etc., are averaged (or totaled) 
over all the repetitions of the replicate type. The only new feature 
arises in the analysis of variance and the estimation of the weights. 
The structure of the analysis of variance is now as in Table 23.3. 


TABLE 23.3 STRUCTURE OF ANALYSIS OF VARIANCE FOR SIMPLE LATTICE WITH 


r/2 REPETITIONS 
Mean Expectation of 


Due to df Square Mean Square 
Replicates 1 — 1 
Blocks eliminating 
treatments N 

Component a (r — 2)(p — 1) Bi o + poy 

Component b 2(p — 1) 82 + : os 
Treatments p-1 
Error (intrablock) (r - 1)(p —- 1} ＋ - 2p — 0 E 02 

A NOT uUam 
Total rp — 1 


The component b for blocks eliminating treatments is the same as 
before, if we take account of the fact that there are r/2 times as many 
replieates. Component a is obtained by noting that A is completely 
confounded in r/2 replicates, of type I, say, and therefore the interaction 
A by replicates I has (r/2 — 1)(p — 1) degrees of freedom, with mean 
square of c? + po? The actual sum of squares may be written 


1 
EOM y ARCU (0% 1. (8) 
Be d 7 Tk M 
2 


where (i-)1, = the total yield for level i of factor a in the kth replicate 
of type I 
(„hie = the total yield of the kth replicate of type I 
(i-)r. = the total yield with level i of factor a in all the replicates 
of type I 
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and 
( ur. = the total of all yields in the replicates of type I 


Similarly, the interaction B by (replicates of type II) gives (r/2 — 1) 
X (p — 1) degrees of freedom, with a sum of squares obtained by inter- 
changing i and j and I and II. 

As an estimate of W we use 1/E, and of W’ we may use 1/81. We may, 
however, combine components a and b to give a mean square, B, say, 


with expectation c 6 Es i pe bè» In that case the expectation of 
r 


ne =E ‘ 2 2 $ 3 Tid A 
is c^ + po», so that an estimate of W” is and this is 
g= rB— E 


the estimate generally used. 


23.44 THE ANALYSIS OF OTHER LATTICE DESIGNS 


23.1.1 The Triple Lattice 
Tn this ease with 3 replicates, we confound A in replicate I, B in rep- 
licate II, and AB, say, in replicate III. As in the case of the simple 

lattice, the best estimate of the A effect is 
W'Ai + WAn + WAm 


9 
W' 4 2W E 


which equals 
1 N- 
= (41 + An + Am) + ———— (241 - An — 10 
rice 11 m tam An — Am) (10) 


where Ay is any component of the effect of factor a. Following the same 
lines as before, we find that the estimate of the yield of a treatment is 
the mean of the treatment in the 3 replicates plus 3 corrections, say, 
Cai; Chj, Cabk, Where, if a treatment is denoted by (ijk), i being the level 
of factor a, j of factor b, and k of AB (i.e., equal to 7 + j mod p), 


Cai = N2(i-)r (i-) n - Gm] 
ej = M— CJ + 20j-)n — (Jm (11) 
cat = M- Ck) — (hn + 2( kn] 


where \ = (W' — W)/3(W’ + 2W), the terms (i- -)r, ete., being means. 
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The analysis of variance has the structure given in Table 23.4. 


TABLE 23.4 STRUCTURE OF ANALYSIS OF VARIANCE FOR TRIPLE LATTICE 


Mean Expectation of 


Due to df Square Mean Square 
Replicates 2 
Blocks eliminating treatments 3(p — 1) B ce? + Spo" 
Treatments p-1 
Error (intrablock) (2p — 1)(p — 1) E 02 
Total 3p? —1 


The sum of squares for blocks eliminating treatments is obtained by 
considering the quantities, as totals: 


2(--) — ( ) — Gm 
— (d + 26j2n = C2 
(n — CE) + 2C -k)i 


We form the sums of squares about the mean of each of these quantities 
for the possible values of 7, j, k, respectively, and divide by 6p. We 
may then use as estimates of the weights:w' — 1/E and w' = 2/(3B — E). 

With repetitions, say, 7/3, of the 3 basic replicates, the only modifica- 
tions in the analysis are: 


1. That the quantities (/--)r, etc., are totals over all replicates of 
r 
type I, etc., and the divisor in the sum of squares is 65 3 = pr. 


2. That there is an additional component of the sum of squares for 
blocks eliminating treatments: namely, the variation of the A effect 
over replicates of type I, the B effect over replicates of type II, and the 
AB interaction over replicates of type III. This sum of squares will 
have (r — 3)(p — 1) degrees of freedom, with a mean square Bz, which 
has an expectation of (c? + pa’»). 

3. For w’, if we denote the mean square for the total sum of squares 
for blocks eliminating treatments by B, we may use 


r-i 
75 — E 


w = 


an expression formally identical with that for the simple lattice. 
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23.4.2 The 3-Dimensional Lattice 


Here we shall consider the 3-dimensional lattice with 3 replicates in 
which the confounding is: 


Replicate Confounding 
I B, C, and BC interactions 
Hu C, A, and AC interactions 
Ill A, B, and AB interactions 


The best estimates of effects and interactions are exemplified by 
1- WA; + W'An + W'Am 


W --2W' 
Ar 8 (241 An — At) 
3(W + 207) 
7 s WAB: + WABy + W'A Bin A 
2W --W' 

= ABr + SU (AB, + ABy — 24 BUI 
ie 3(2W + W^ 
ABC = ABCr 


The computational procedure given by Yates! may be used for this 
particular case. This procedure consists essentially of obtaining an ad- 
justment for each of the possible 2-way tables and is possible because no 


3-factor interactions are confounded. We shall give an alternative 
method later. 


23.4.3 The 5-Dimensional Lattice 


As a final example which presents the problems in full complexity, 
we may consider the 5-dimensional lattice with 5 replicates, each having 
a different scheme of confounding. The p® treatments are represented 
by the levels of 5 factors each at p levels, say, a, b, c, d, e, and the con- 
founding in the 5 replicates may be taken to be as shown in Table 23.5. 


TABLE 23.5 
Replicate Confounding 
I B, C, D, E and all interactions 
II A, C, D, E and all interactions 
III A, B, D, E and all interactions 
IV A, B, C, E and all interactions 
Vv A, B, C, D and all interactions 
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Given the weights W and W’, the estimation of all the effects and inter- 
actions is exemplified by the following: 


„ WAIT W'An + W'Am  W'Ary + Ax 
A a 
W+4W’ 


iB ABI + ABU + NABU + W'ABry + W'ABy 


2W +3W’ 
ABO + WABCy + ABG + W'ABCiy + W'ABCv (13) 


c 


3W + 2W' 


bob - WABCDI+ WABCDu + WABCDm + WABCDry + W'ABCDy 
$ NUTS AW + W' 


rre 
ABCDE = ABCDEy 


for any component of the respective interactions. 
The combination of the effects and interactions to give the estimates 
of the yields of the treatments will be tedious, but straightforward. 
The estimation of the weights is the only new problem, and this is 
the reason for describing this design. The analysis of variance has the 
structure shown in Table 23.6. 


TABLE 23.6 
df 
Replicates 4 
Blocks eliminating treatments 505 — 1) 
"Treatments 55 — 1 
Error (intrabloek) 4 — 55 + 1 
Total 5p — 1 


The analysis of variance is itself a problem, and the expectation of 
the mean square for blocks eliminating treatments an allied one. 

If we consider the A effect, it is confounded in replicates II, III, IV, 
and V, and the interaction of the A effect with these replicates with 
3(p — 1) degrees of freedom will have a mean square of c? + po^y, for 
its sum of squares consists of a sum of squares between block totals. 
The other main effects contribute 3(p — 1) degrees of freedom each 
with the same expectation. There are in all 20 possible choices of 2 
letters from the 5 letters, A, B, C, D, E, and, given any 2 letters, there 
are (p — 1) sets of (p — 1) degrees of freedom for the interaction of the 
2 factors corresponding to the 2 letters. Any of these sets of (p — 1) 
degrees of freedom is confounded in 3 of the replicates, so that the inter- 
action of the particular 2-factor interaction with replicates in which it 
is confounded gives a sum of squares with 2(p — 1) degrees of freedom 
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and a mean square with expectation c? + po. All the 3-factor inter- 
actions are confounded in 2 of the given replicates, and these give a 
similar contribution. 

Corresponding to the above comparison, there are comparisons be- 
tween the mean of effects (or interactions) when confounded and the 
mean of the same effects when unconfounded. For example, we may 
consider 

Ay — 4 (An + Am + Atv + Av) 


this quantity contains only block errors n and within-block errors e. 
These quantities squared, and added over the possible A comparisons, 
give, with the appropriate divisor, a sum of squares with (p — 1) de- 
grees of freedom, for which the expectation of the mean square is 
c? + tpos. Similarly, with the AB interaction, we may consider 


AB, + ABy AE + ABV + AB 
2 3 


which contains only 's and e's. These quantities lead to a mean square 
with expectation c? + 2&po?,. 

In general, we may compare the mean of an interaction over the ne 
replicates, in which it is confounded, with the mean of the same inter- 
action over the n, replicates, in which it is unconfounded. Let X be 
the interaction, and suppose it corresponds to the equations, 


È aiti = 0, 1,2, P uri (p — 1) mod p 
1 
and let X, be the total of the plots for which 
25 ax; = j mod p 
i 
in the kth replicate in which X is confounded. Let X jı be the correspond- 


ing total in the Ith replicate in which X is unconfounded. Here k will 
run from 1 to n, and J from 1 to nu. Consider the quantity 


1 1 1 1 ? 
. ; 
2: 2 — jk " x il Mp x Xj T x Xa) 


j np j 


which is the sum of squares of comparisons orthogonal to treatment 
comparisons. The expectation of the whole is easily found to be 


o- D» (S (o pe^) 


ny ＋ n. 
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Ne 


The divisor to give the sum of squares is »( ) and the expecta- 


" L NyNe 
tion of the mean square is therefore 
Nu 


Ny + n. 


02 + pos / 
From this result Table 23.7 may be completed, it being a simple mat- 


TABLE 23.7 PARTITION or Brock DEGREES or FREEDOM FOR p* TREATMENTS IN 
Brocks or p WITH 5 REPLICATES 


Expectation of 
df Mean Square 
Comparison between replicates of 
effects or interactions which are 
confounded in these replicates: 
Main effects 15(p — 1) 
2-factor interactions 20(p — 1)? c? + po% 
3-factor interactions 10(p — 1)? 
Comparisons between mean of con- 
founded effects and mean of 
unconfounded effects: 
Main effects 5(p — 1) e? + ob 
2-factor interactions 10(p — 1)? c? + $po% 
3-factor interactions 10(p — 1)? c? + $p0% 
4-factor interactions 5(p — 1)* ce? + $pos 


ter to verify the orthogonality of the comparisons. This result may also 
be used to show that, for any lattice design arranged in replicates, the 


rB—E 
1 where B is the mean square for 


expectation of the quantity 
Tc 


blocks eliminating treatments and E is the error mean square, has an 
expectation of c? + N, where k is the size of block. 


23.5 THE VARIANCE OF TREATMENT COMPARISONS 


We have used the fact that yields may be expressed in terms of the 
effects and interactions in the setting up of the designs, and we now 
turn to the consideration of treatment differences and the accuracy with 
which they are estimated. Any treatment difference may be expressed 
in terms of effects and interactions: for example, with p = 7, and 2 
pseudofactors, 


loo = p + Ao + Bo + ABo + AB% + AB% + AB's + AB's + AB% 
loy = u + 40 + B, + AB, + AB’: + AB’, + AB‘, + AB's + AB's 
(14) 
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and 
too — to: = (Bo — Bi) + (ABo — ABI) + (AB?o — AB*;) 
+ (AB — AB%s) + (AB'o — AB'4) + (AB* — AB's) 
4- (AB% — AB%) (15) 


Since the errors of each of the estimates of the differences By — Bi, 

ABy — AB,, AB’ 427, ete., are uncorrelated, the variance of 

(too — toi) is the sum of the variances of the differences. With the 
. simple lattice with 2 replicates the variances of the differences are: 


2 
Bo — BI: variance ———— —— — 
TW. + W’) 
ABy — AB, 
AB, — AB?; 
: variance —— 
14W 
AB*, — AB*, 


The variance of the difference (fo — £y) is then 


PU RR 6 
ictus y =) 
T\W+W 2 
If W' = W = 1/o? this variance becomes 27 7/2W = o°, as we would 
expect, 
In the case of the simple lattice, the same variance will hold for any 


2 treatments that occur together in a block in 1 of the 2 replicates. If 
2 treatments do not occur together in a block in either of the replicates, 


hn basal: 5 
the variance is 6s + x) because their difference contains 


differences from both main effeets. Rather than consider all the pos- 
sible treatment differences and their errors, it is usually satisfactory to 
obtain an average variance of the possible treatment differences, and its 
square root, which may be used as an average standard error. We 
therefore find the average variance of the differences between one treat- 
ment and all the others. For the case of p" treatments, any treatment 
difference will involve a difference with respect to an effect or inter- 
action for (p" — p"^!) other treatments. For example, with the 7? 
lattice, the treatments (1j), such that the differenee between them and 
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the control contains a difference with respect to AB’, are those that 
satisfy 
i+ 2j * 0 mod 7 


to which there are (7? — 7) solutions. If, then, we form all the (p* — 1) 
differences between the control and the other treatments and average 
their variances, we shall have 


n — paml 
(T [var (A) + var (B) + var (AB) + var (AB?) + 
p'- 
+ var (AB?!) + var (C) + var (AC) K var (ABC) +++ 
+ var (AB = + ete.] (16) 


there being (p^ — 1)/(p — 1) symbols in the square brackets, and each 
var (A), etc., being the variance of a difference of 2 of the quantities 
Ao, Ai, 42, „ 45-1 o i 

If an effect or interaction X is confounded in ne replicates and uncon- 


2 1 
founded in n, replicates, var (X) is = e 
p 


n,W + n,W' 
In general, therefore, the mean variance is 
2(p — 1) | no ny Ns E 
22 ——ĩ : 
(vn — 1) LW“ T= DW' sW + (r - S9W' TW 


(7) 


where n, is the number of sets of (p — 1) degrees of freedom confounded 
in (r — s) of the total of r replicates. The n, satisfy the relations: 


ft 
— = 18 
no + my een PIT (18) 


and 


"-1 
nor + m(r- D-E mr = 2) m A *) (19) 


Thus, with 3° treatments and 4 replicates, p = 3, n = 3, r = 4 and 
confounding as follows: replicate I: A, B, AB, AB?; replicate II: A, €, 
AC, AC? ; replicate III: B, C, BC, BCi; and replicate IV: AB, AC, BC?, 
AB*C?; we have no = n; = 0, na = 6, ns = 4, and n4 = 3, so that the 
mean variance is 


2 6 4 0 
—— —— + — 2 20) 
13 t + IW * 3W--W | 4W 
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We have, therefore, the following mean variances of treatment dif- 
ferences: ! 


Simple lattice with 2 replicates: 


2 2 -1 
ate Gear Ye ) (21) 
p+1\W+Ww ow 
Simple lattice with 4 replicates: 
1 2 — 
—— et) (22) 
pt+i\W+Ww W 
Triple lattice with 3 replicates: 
2 3 -2 
aret) (23) 
p-1MW --W 37 
3-dimensional lattice with 3 replicates: 
2(p—1 3 3(p—1 — 1)? ' 
2 J (p E — 20 
( I LW --2W' 2 -W' 3W 
4-dimensional lattice with 4 replicates: 
2(p — > | 4 60 1) 4p—1?* ( 5 (25) 
(5 — Lan“ 2W+2W' 3W+W’ 4W 


Frequently W’ will be small relative to W, and the contribution to 
the mean variance of effects or interactions which are confounded in 
all the replicates would be correspondingly large. For this reason it is 
usual to insist on the condition that no effect be confounded with blocks 
in all replicates of a practical design. 

It will usually be advisable as a check on the use of the avers age vari- 
ance, to calculate the variance of a treatment difference separately for 
the cases when the 2 treatments occur zero, once, twice, etc., times to- 
gether in a block. These variances are as follows: 


Simple lattice with 2 replicates: 


Together in a block once: rw + a ) 
W+ Ww’ 2W 
Together in a block zero times: < (F : is s) 
Triple lattice with 3 replicates: : + AE 
Together in a block once: — 7 = v) 
p\2w 4 wet 3W 
yy 
p 


-3 
Together in a block zero times: 42 75 
2W + wt In 
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3-dimensional lattice with 3 replicates: 


2 levels of pseudofactors common: 


oj 1 io R 


plaw +w  W'-2W 3W 

1 level of pseudofactors common: 
E ORE cs vi eec 
p i2W'--W W'+2Ww 3W 

0 level of pseudofactors common: 
2 3 3(p — 2) p 
zem WW '42W 3W 


'The variances for any other design may be evaluated easily by noting 
how many main effect, 2-factor interaction, 3-factor interaction com- 
parisons enter into the comparison of 2 treatments. 


23.6 THE EFFECTS OF INACCURACIES IN THE WEIGHTS 


We shall suppose that the analysis of variance of the experiment con- 
tains a component for blocks with N degrees of freedom the expectation 
of whose mean square, B, say, is c? + po». The weights that will be 
used are w = 1/E, E being the intrablock error mean square based on 
N degrees of freedom, and w' — 1/B. The distinction we have used 
between true weights (capitals) and estimated weights (lower case) 
should be noted. 

In order to make any investigation at all, we must use the infinite 
model at least to the extent of assuming that the actual sum of squares 
is distributed as X. In this case, NW/w is distributed according to the 
x? distribution with N degrees of freedom, and VH is distributed 
independently of W/w, according to the x? distribution with N’ degrees 

, 


of freedom. The ratio m is then distributed according to the F 
— | 


distribution with N’ and N degrees of freedom. 

If an effect or interaction X is confounded in ne replicates and uncon- 
founded in n, replicates, the estimate of a difference X; — X; we have 
used is 


n,w' X, + nwXu (26) 


2- nw’ + nuw 


where X, is the mean of (X; — Xj) over the replicates in which X is 
confounded, and X, the mean over the replicates in which X is uncon- 
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founded. The true variance of X, is 1/n,W’, and of X, is 1/n,W, so 
the true variance of X is v? 102 
Ne wW + nu W 
(new + nuw)? 
the constant of proportionality 2/p"—! being omitted. 
Note that, if w actually equals W’, and w actually equals W, this 


(27) 


becomes 1 : 
NeW’ + nW 
Now, j k [ 
mz w? w? 
(n7 + nu 5) i 4 NNW a (F +1)? 85 
(new! + nw)? nW'-En,W (nw + nuw)? (nW + nW) 
where D | 
p 
Then, if we put W' = kW, the variance of the actual estimate 
= variance without inaccuracies in weights 
1 uk(F — 1)? 
NcNyk( ) (29) 


W (nck + nyF)?(nck.+ n.) 
If w/w’ is found to be less than unity, the value of unity is used, Since 


= —— -k— 30 
w k (30) 


equal weights are used if F is less than k, and, in this case, the increase 
in variance for the estimate of the effect is 
nune(k — 1)? Nyne(k — 1)? 
Mr s Mihi KS TTT 
KW (ne + nu)? (nck + my) — kW (nik + nu) 
Adding over all the possible effects and interactions, we shall obtain the 
increase in average variance due to inaccuracies in the weights, which 
is a constant if F is less than k, and is a function of F if F is greater than 
k. The percentage loss in information due to the inaccuracies in the 
weights may then be obtained. 
In the case of the 3-dimensional lattice with 3 replicates given earlier 
in the chapter, the average variance using the true weights W and W’ is 


| 3 3(p—1) | (p- £] 
(p! DLiW-2W' 2W--W' aw 


(31) 


THE EFFECTS OF INACCURACIES IN THE WEIGHTS 465 


that is, 


(p-1 W 1-2k 24k TT 


The increase in variance due to inaccuracies in the weights is 
2(p-1y 1f 39-24k(F— 1)? | 3(p— 1)1-2k(F — 1)? 
(0 — i) W lm. TTD TI) (b+ F + 2) | 
and 

2(p— 1) 1p3:2-1-(k— D? 30 — 1)1-2-(k- 2A 

(p —1) ml k-9-(2k 4-1) - k-9(k + 2) i 


(32) 


2(p - 1) a 3 080 D eral 


F>k 


F<k (33) 
If k equals unity, these expressions reduce to 
4(p—1) 1 — 1) 
. = |@- wom sl 
(p^ D (2+F)? (1+ 2F) 
and 0, E Eu 


Since, with k equal to unity W’ = W, the best estimates have an av- 
erage variance of differences of 2/3W, the proportional increase in av- 


erage variance i8 

6(p — 1) [ 1 2 

:::: ̃— — — (34) 
(p> — 90 ) Q-F* Q-2F)? 

if F is greater than unity. With the more particular case of p = 3, the 

proportional increase is 


6 Bs: 2 is 

3 N ls N bri 
if F is greater than unity. The result of Yates' for this case appears to 
be in error. 

If the weight W’ is not estimated so simply as in the above discussion, 
the problem becomes more complex. For example, suppose we have a 
3-dimensional lattice and use the pooled mean square for blocks B elim- 
inating treatments to estimate W’. This mean square is obtained from 
the 3 components (Table 23.8). 


+ KT 


Taste 23.8 
Mean Expectation of 
Component df Square Mean Square 
a 3p- wo „ 


b 3p — 1) By e! + pe^ + 
c 3(p — 1} Be o + Ẹpo 
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Then, ^ 
Un 3(p Br 1)Ba + 3(p 7 1)B, + 3(p um 1) B. 


. 8(p — 1) 


and has an expectation of c? + 24pc?;. 
The estimate of W’ which is used is then 


2 


, ^ . 


38 — E 


The examination of inaccuracies in the weights does not proceed in the 

simple fashion outlined for the previous case, because 3(p? — 1)B is 

not distributed as x*(c? + 24po?;) with 3(p? — 1) degrees of freedom 
For w^ have: 


3(p — 1)B, is distributed as x*(c? + po*,) with 3tp — 1) df 
3(p — 1)By is distributed as x?(s? + M4pe?,) with 3(p — 1) df 
3(p — 1)°B, is distributed as x( + 24pc?;) with 3(p — 1)? df 


The evaluation of the loss in information in this case, therefore, requires 
the use of distributions which are not simple nor tabulated. The work 
of Robbins and Pitman ? may possibly be applied to the problem: They 
have obtained a general solution for the distribution of B and B/E, E 
being the error mean square. 

As the simple and triple lattices with 2 and 3 replicates, respectively, 
are perhaps the most widely used designs, it seems advisable to make an 
examination in their case. We suppose then that we have mean squares 
B and E with expectations (9 + pe) and c?, respectively, and that 

N'B is distributed as x( + ppo*,) with N’ degrees of freedom and 
NE as x70” with N degrees of freedom, independently of each other. 


The weights that will be used are then w = 1/E and w’ = Bi 

B+ (p — DE 
The variance of the estimate of an effect confounded in ne replicates 
and unconfounded in n, replicates is 


(Sent) 
ar m 


(new + nyw)? 
which equals 


w? /W' w 2 
nenw ( Ze. 1) 
1 W'\W w’ 


ee! yee il cou v 
NeW’ n. (naw + nuw) (nW + n,W) SA Deforo 
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In this case NE/c? is distributed as x” with N degrees of freedom, and 
N'B/(o? + ppc?;) is distributed as x! with N' degrees of freedom. 

Therefore, (c?/E) X [B/(s? + ppc??)] is distributed as F with N’ and 
N degrees of freedom. But 


LSU p 
Bt (pe = 
w 
or 
— 1 
: at (0-0 
A w w 
an 
52 w 
— 36 
5 BR (36) 
so 
(5-5) 
w Ni. w 
Wig zi 
M. wW 
is distributed as F, i.e., 
wp ih (o — 1) 


rof Aou me. vada — 
vw. - W ) „(5 W 
is distributed as F. If we let W’ = kW, the quantity w/w' is distributed 
as ^ 
( ine 3 pu 
- ( + ) (37) 
p 
k 


where F is distributed according to the F distribution with N' and N. 
degrees of freedom. The increase in variance for the particular effect 


is then x 
w 

nene 0 —— 1) 
w 


kW (ne + ny =) (nck + nu) 


The expected value of this increase may be obtained by numerical in- 
tegration over the F distribution, and the expected increase in the mean 
variance of comparisons may be estimated for any particular design. 
In performing the integration, it should be noted that, if W” is estimated 
to be greater than W, the estimated value is not used, but it is assumed 
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that W = W'. When equal weights are used, the increase in variance 
of an effect or interaction is 


3 nune(æ — 1)? 
In the case of the triple lattice for p? treatments, we had 
N' = 3(p = 1) 
N = (2p — 1)(p — 1) 
p= 1 
so that w/w’ is distributed as 26 T )) (r — — 
2Nk 2/k 4- 1 


The increase in average variance of treatment differences is 


w 2 
12 w’ w 
( FP EE KM m for SAd 
4 m2) (+2) 
Ww 
38 
pud 12 (k— 1)? 10 Ps 
AUCI PES el 
(p+1) kW-9-(k + 2) w' 


The average proportional increase in variance for the case p= 5 was 
obtained approximately by numerical integration and was found to be 
as follows: w 

w 1 2 3 4 5 10 


Percent 12 2.3 27 2.7 23 0.8 


The results published by Yates,! together with this case, indicate that 
the effect of inaccuracies of the weights on the variance of treatment 
comparisons is of the order of 1, 2, or 3 percent, and, therefore, trivial. 
The effect of inaccuracies of the weights will increase as the number of 
degrees of freedom for interblock and intrablock error decrease. Usu- 
ally the number of degrees of freedom for intrablock error is sufficiently 
large, and, as a practical rule with lattice designs, it is probably safe to 
say that the effect of inaccuracies will be inappreciable if the interblock 
mean square is based on 10 or more degrees of freedom. With a smaller 
number of degrees of freedom, it is best to assume that W’ = 0, and to 

` utilize only intrablock information. 

So far we have examined the effects of inaccuracies in the weights on 
the average variance of treatment differences in terms of the true 
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weights W and W’, and there still remains the question of the extent 
to which the estimated variance in terms of w and w’ is a reasonable 
estimate of the variance of the differences actually estimated. The es- 
timated variance will be used to test single degree of freedom compari- 
sons, by what amounts to a normal theory test. Since the calculated 
variance will be less than the true variance of the actual estimate, the 
normal theory test will tend to give too high a significance level. It does 
not appear easy to determine the bias in the calculated significance level. 


23.7 THE ANALYSIS OF LATTICE DESIGNS AS COMPLETE 
RANDOMIZED BLOCK DESIGNS 


It was shown by Yates! that a p° and a p° lattice design in blocks 
of p plots may be analyzed as a complete randomized block experiment. 
His method of proof depends on the fact that, if, under a particular 
analysis, the expectation of the treatment mean square, in the absence 
of treatment effects, is equal to expectation of the error mean square, 
this analysis gives an unbiased estimate of the error to which treatment 
comparisons will be subject. This is not necessarily true, for the error 
sum of squares must be homogeneous. - 

Suppose we have an experiment on p” treatments in a lattice design 
with blocks of p plots and r replicates, and consider an effect or inter- 
action X which is confounded in ne replicates and unconfounded in 
n, [= (r — n,)] replicates. Let Xix be the sum of the plot yields with 
the ith level of factor z (or of the interaction) in the kth replicate. Then 
the sum of squares for X is equal to 


„ NN 


Apart from the treatment constants, the expectation of the square of 
any quantity in brackets is 


(nep? — 1)? + «(p^ e 
n — p 1 ; TE 2 c? 
[v (= ) +r = Pp 3] 


np" (p — 1e + rp" *(p — 0e? 


The expectation of the sum of squares for X is then 


(p — 1) G fs v) 


which equals 
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We may use previous results to obtain the sum of squares for X by 
replicates (Table 23.9). 


TABLE 23.9 
; Expected 
af Mean Square 
X by replicates in which confounded versus : 
replicates in which unconfounded p-1 a + = po^, 
X by replicates in which gonfounded (ne — 1)(p — 1) a? + pos 
X by replicates in which unconfounded (n, — 1)(p — 1) g? 


The mean square for the error of X is then 


1 n 
2 2 — = 
: en 1 0) 
= o + pots | 


ny + rn, — "| 
r(r — 1) 


= g?-F— po, since n, n, =r (39) 
r 


The set of (p^ — 1) degrees of freedom for treatments ignoring blocks 
is partitioned into (p^ — 1)/(p — 1) sets of (p — 1) degrees of freedom, 
and the error sum of squares with a complete randomized block analysis 
may be partitioned into (p" — 1)/(p — 1) sets of (r — 1)(p — 1) de- 
grees of freedom. The above shows that the expectation of the mean 
square for a set of (p — 1) degrees of freedom belonging to treatments 
is the same, apart from true treatment effects, as the expectation of the 
mean square of the corresponding (r — 1)(p — 1) degrees of freedom for 
error (replicate by treatment). 

An ordinary randomized block analysis of a quasifactorial design with 
one restriction is, therefore, valid insofar as the expectation of the 
treatment mean squares is the same as the expectation of the randomized 
block error mean square. It follows then, from consideration of the 
randomization test, that the complete randomized block analysis gives 
a reasonably valid test of the null hypothesis that there are no treat- 
ment effects. A test may also be made, of course, with the intrablock 
treatment and error mean squares. Difficulties do arise, however, as 
soon as we wish to ascribe errors to treatment comparisons obtained 
from the ordinary treatment averages, because we have shown that the 
complete error sum of squares with (r — 1)(p" — 1) degrees of freedom 
is not homogeneous if c?, is greater than zero. 

We may examine the true errors of the possible types of comparison 
among 2 treatments, whether they occur in a block together, not at all, 
once, twice, etc. If 2 treatments occur together in a block in s out of 
r of the replicates, the variance of the difference of the treatment av- 
erages is 
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1 2 
z [2re? + 2(r — G) = à [re? + (r — S) 


1 50 


T 


The average error variance from the complete randomized block analy- 
sis is the average over the (p" — 1)/(p — 1) effects or interactions, each 


ar 
with (p — 1) degrees of freedom, of c? + — po?,, The sum of n, over 
T 


ps9 4 — 1 si. 1 
all the effects and interactions is ) because E) 


sets of (p — 1) degrees of freedom are confounded in each replicate, and 


n 
so the average of c? 4- — po? is 
T 


n=l .. 1 
ATEM i ur 
which equals J ud 
eroi) 


In using the complete randomized block analysis, we attribute to the 
difference of any 2 treatments a variance with expectation 


T 


The deviation of the true variance of the treatment difference from the 
expectation of the actual variance attributed to the treatment compari- 
son by the randomized block analysis is then equal to f 


2 ( z P) ES 

r p21 

We now consider two special cases: 

(a) Simple Lattice: n = 2, r = 2, 8 = 0 or 1 
s = 0: true variance = (e? + o°») 
s = 1: true variance = (o? + 407s) 
Variance from randomized block analysis 


-[#+ - A ] 


Therefore, the variance for a difference between 2 treatments not occur- 
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ring in a block together is underestimated by ( ) c^, The vari- 


p+l 
ance for treatments occurring in a block is overestimated by 

1 1 E 

Gr - 

l 2(p + 1) 
or approximately Jh. The overestimation of the latter variance is 
the more important practically. If, however, 0”, is small, the errors of 
the variances given by the randomized block analysis will be small, 


and, if c?, is not small, the recovery of interblock information should 
be performed. 


(b) Triple Lattice: n = 2, r = 3, 6 0 or 
s = 0: true variance = 2(s? + 270 
s = 1: true variance = $(c? + 302% 


Variance from randomized block analysis 


m. «( -— 
= 5 [e+ ( ptl 


In this case the overestimation of variance of differences of type s= 1 
is less, 

It appears, as a general rule with the simple lattice design and to a 
less extent with the triple lattice design, that the ordinary randomized 
block analysis is not satisfactory for comparison of treatments occurring 
together within a block. For designs with more than 3 replicates with 
different confounding, the discrepancies will be small. 


23.8 THE EFFICIENCY OF LATTICE DESIGNS RELATIVE 
TO COMPLETE RANDOMIZED BLOCKS 


We saw in the previous sections that the true mean variance of treat- 
ment comparisons, estimated with true weights, was 


2(p — 1) ET m N n2 
( fn“ WOC = n 2W + (r— 2)W' 


whereas the true mean variance with the complete randomized block 


analysis is 
2 1 —1 
E 
r p 1 


+ «x 
^ rW 


which equals 
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F T " +o- (5 = 5) 


2 (= sey 4: p" Rii =) 
(* — 1) M. . 


The efficieney of the lattice in blocks of p plots relative to complete 
randomized blocks (i.e., blocks of p" plots) is 


pet — 1 e 
E 


that is, 


* Ww 
LU n nN Nn, m 
„ H =] 
(p DF oe ae cam tw 


This quantity has been evaluated for the range of values of W/W’ and 
is given in Table 23.10. The designs considered are n-dimensional lat- 


TABLE 23.10 EFFICIENCY OF n-DIMENSIONAL LATTICE DESIGNS FOR- p” VARIETIES 
with n REPLICATES RELATIVE TO RANDOMIZED COMPLETE BLOCKS 


w/w’ 
p n » 1 2 3 4 5 6 7 8 9 10 
2 2 4 100 109 125 143 162 181 200 220 239 259 
M. 8 100 110 127 146 165 185 205 225 245 206 
2 4 16 100 110 127 146 165 185 -205 225 245 200 
2 5 32 100 110 128 147 166 186 200. 220 246 266 
2 6 64 10 111 128 147 167 187 208 228 248 269 
2 7 128 100 111 120 148 ies 180 20 2390 251 271 
2 8 256 100 111 129 149 170 190 211 . 232 253 274 
2 9 512 joo 111 130 150 170 192 213 234 250 277 
2 10 1024 00 111 180. 150 1727 1089 214 3 258 280 
3 2 9 100 107 120 135 150 166 182 198 214 231 
3 3 27 100 108 123 139 156 172 191 208 220 244 
3 4 81 100 109 124 141 159 177 195 213 232 250 
3 5 243 100 100 125 142 (160 179 198 217 230 255 
3 6 720 100 110 126 144 162 182 201 220 240 259 
5 2 25 10 105 114 125 13% 148 100 172 184 196 
5 3 125 100 106 117 1%, 142 155 168 182 196 200 
5 4 625 100 1060 118 (131 (14 18 172 186 200 215 
12 49 100 104 111 120 1 188 147 157 167 176 
7 3 343 100 108 113 123 133 143 154 105 176 186 
11 2 121 100 103 108 114 120 127 133 140 147 15 
13 2 169 100 109 io 1 1% 198 129 185 141 147 


tices in blocks of p plots with n replicates, (n — 1) of the main effects 
and their interactions being confounded. These designs are in a sense 
balanced. It should be noted that W/W’ will not be comparable from 
line to line in the table. The relation obtained by Fairfield Smith 
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(Chapter 11) could be used to give an idea of relative efficiencies for 
the different cases, but this would necessarily be in terms of the parame- 
ter b of that relation. 
This evaluation of the relative efficiency of lattice designs assumes 
that the same size, shape, and orientation of the plots is used in the two 
cases and that the replicates are the same, the difference being merely 
in the allocation of treatments. Such a comparison is not always en- 
` tirely justified, because, with a completely randomized design, one 
might use a plot of different relative dimensions. 

It should also be noted that we have expressed the efficiency in terms 
of the true weights W and W’, and not of the estimated weights w and 
w’. It may be suspected that the use of the estimated weights tends to 
overestimate the relative efficiency of an actual experiment. 

The relative efficiency of the design will be lowered considerably by 
allowing some effects or interactions to be confounded in all the repli- 
cates, and this is particularly so if it should happen that W/W’ is large. 
This case is not included in the table. 


23.9 THE COMPARISON OF p" TREATMENTS IN BLOCKS 
OF p PLOTS (s > 1) 


There are no difficulties in extending the methods of the present 
chapter to the case of comparing p" treatments in blocks the size of 
which is a power of p. As an example which is reasonably practical, 
suppose we wish to compare 32 (= 2°) treatments in blocks of 4 (= 27) 
plots, and denote the pseudofactors by a, b, c, d, e. There are 165 pos- 
sible systems of confounding for the 2° system in blocks of 4. At least 
3 replicates must be used if no effect or interaction is to be confounded 
in all replicates. A set of 3 replicates is the following: 


Replicate Confounding 
I A, B, AB, C, AC, BC, ABC 
Il A, D, AD, E, AE, DE, ADE 
III B, D, BD, E, BE, DE, BDE 


The estimate of A is 


Á H W'Ay + W'An T W Am 
2W' --W 
( — W) 


-4 „ ma | A 7 — 2 41) 
T SQW + 728 1+ An — 24m) ( 


and so on. 
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The structure of the analysis of variance is given in Table 23.11. 


TABLE 23.11 
Expectation of 
Due to df Mean Square 
Replicates 2 : 
Blocks eliminating treatments 
Effects X confounded in 2 replicates: 
X by (replicates in which confounded versus 
replicates in which unconfounded) 5 e? + 440% 
Effects X confounded in 1 replicate: ; 
X by (replicates in which confounded versus 


replicates in which unconfounded) 11 c? + 3.40%, 
Effects X confounded in 2 replicates: 

X by (replicates in which confounded) 5 a + 40%, 
Treatments ; 31 ! 
Error intrablock 4l 02 

Total 95 


The analysis presents no new difficulties. 

If it is the case that n is a multiple of s, say, ks, the experiment may 
be represented as one on k factors each with p* levels. The representa- 
tion based on the Galois field of p* elements, as discussed in Chapter 17, 
may be used, to give directly schemes of confounding in blocks of p* 
plots. These schemes will be a subset of the schemes obtained by con- 
sideration of the ks factors each at p levels. The only virtue of using 
the more complex representation is that from it we may obtain a set 
of schemes of confounding which is balanced in the sense of every effect 
and interaction (each with p’ — 1 degrees of freedom) being confounded 
equally frequently, this set being a subset of all the schemes of confound- 
ing derived from the simpler representation, which uses the Galois field 
of p elements. Y 

There remains only the question of the relative values of designs using 
varying sizes of block. For example, with 81 treatments, there are 2 
possibilities which are of importance, with blocks of 9 plots and blocks 
of 3 plots. We have seen that, with blocks of 9 plots, multiples of a 
simple lattice, or of a triple'lattice, and so on may be used. With blocks 
of 3 plots, it is necessary to use at least 4 replicates. It would be de- 
i e lattice in blocks 


3 plots. Such a comparison is rendered di 
that a relation between W and W’ for the 2 ( 
satisfactory answer has been obtained. 
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23.10 THE NON-PRIME CASE 


We shall deal in this section with the comparison of k” treatments, 
where k is not a prime or a power of a prime. The main difference is 
that the number of possible designs is considerably less, because of the 
non-existence of a k X k completely orthogonalized square. We shall 
find that the analysis and estimates will be the same as in the prime 
case, with k substituted for p, for the designs that exist. 

The model that is used is again the additive one, the yield being made 
up of a constant contribution, treatment effect, block error, and plot 
error, these being uncorrelated as before. 


23.10.1 The Simple Lattice 


Denoting the he treatments by (ij), i and j running from 1 to k, we 
may place treatments with the same i together in a block in the first 
replicate, say, replicate I, and treatments with the same j together in a 
block in the second replicate, say, replicate II. The analysis may be 
derived very simply by utilizing the identity 


Tg Gi. Te) (rg rn) GH =. — 014r.) (42) 


1 
where ri; is the true effect of treatment (ij), 27. = — > rij, ete. The 


7 
terms on the right-hand side are, in order, a comparison confounded with 


blocks in replicate I, a comparison confounded with blocks in replicate II, 
and a comparison unconfounded ir both replicates. If we use the nota- 
tion that (I.) is the observed mean of treatments with first number 
equal to i, in replicate I and so on, the comparison (r;. — r..) is esti- 
mated by [(7-); — (--):] with variance proportional to c? + kc?,, and 
by [G-)n — (::)n] with variance proportional to 2. If we put W — 
1/2?, and W’ = 1/(c? + Ken), the best estimate of (r;. — r..) is then 
WIG.) — C2 en = (- 11] 
; (W’ + W) 
and this equals 
AG) CAd + Gn — C-u) 
3 ln = ü! 
aw T wy en C — Gn m 


Similarly, the best estimate of (r.j ..) is, 
MIC: — C + Cu — C 2l 


(W = W’) í 
aw T wy C1 Cd + CDu = Cu 
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The comparison (ri; — 7;. — r.j + r..) is unconfounded with blocks in 
both replicates, so that the best. estimate of it is 
3G: — G2) — Ci + C 2d lu — G.) u - (n + (n! 
The best estimate of (r.; — r..) is, therefore, identical with that ob- 
tained before, since 


Al — C Or G.) — C ul + CD — C2: + (n = (nl 
+ MG 1 — (i.) CD Cr Gu — Gu — C2u T C ul 
= MG + Gu — C2: — Cul 
that is, the observed mean yield of treatment (ij) as a deviation from 
the observed mean, and the correction terms are as before. The vari- 


-ance of the estimated difference between 2 treatments occurring to- 
gether in a block is, for example, the variance of the estimate of 


(r. = 7. j.) ＋ (ri Tj4—T$-—Ty) 
which is À à 4 f 4 


2 ( 1 + * — 5) 

k\W+W 2W 
The variance of the estimated difference of 2 treatments that do not 
occur together in a block is 


2 ( 2 k= ?) 

kNW +W 2 
Combining these 2 variances according to the relative frequencies, we 
find that the average variance of treatment differences is 


2 ( 2 A * — 5) 
k+1\W+W W 
The analysis of variance and estimation of the weights are identical 
with that given for the prime case. : 


23.10.2 The Triple Lattice 

This design is possible for k? treatments where * is any number be- 
cause a k X k Latin square exists for any number k. We may denote a 
treatment by (ijl), i being the row, j the column, and ! the letter in the 
Latin square on which the treatments are superimposed. The analysis 
is based on the identity 
Tj — Te. = (Tyee — T) ＋ (. — T) n Tj 

+ (rijt — Tie 173. Tet F 27...) (43) 


If rows, columns, and letters are confounded in replicates I, II. and III, 
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respectively, the comparisons (r;.. — 7...) are confounded in replicate I, 
(T.j: — 7...) in replicate II, and (z..; — v...) in replicate III, while 
(79 — Ties — T4. — 724-27...) is completely unconfounded. The 
analysis and estimation are clearly the same as for the prime case, k 
being substituted for p, and we shall not go through the details. 


23.10.3 The 3-Dimensional Lattice 

A 3-dimensional lattice for k? treatments in blocks of k plots with 3 
replicates (or a multiple of these 3) exists for any k, because we may 
arrange the treatments on the points of a k X k X k cubic lattice. A 
replicate of k? blocks of k plots is obtained by taking the lines parallel 
to one of the 3 possible directions, and we may, for purposes of nomen- 
clature, suppose that j and k are constant within blocks of replicate I, 
? and k within blocks of replicate II, and i and j within blocks of rep- 
licate III. The analysis is simply derived by utilizing the identity 


(Tije — T...) = G. — 7.) ＋ (r4. — m...) 

T (ng . 734.40.) 

＋ C. . ..) ＋ ( .. . 1 Tis) 

＋ (1.1 1. . 7 ＋ m) 

T (Tijk — Tij- — Ti — Tk F Ti T4. + 7T. — 7...) (44) 
The main effect terms, 2-factor interaction terms, and 3-factor interac- 


tion terms are confounded in 2, 1, and 0 of the replicates, respectively. 
Estimates of the differences of the rij May be obtained by computing 


Ia 120 01 — (Gu — (ie ni 
t [7CJ2r + 2(32n - (Jm 
＋ [Ci — CHE) + 2(--Emll 


r = Tijk + 


, 


T 30v 27 UG) + (j)ri — 203-)m — (i+) — (n 
t 20. ) m - CJ: — Cn ＋ (J.) m +O tO 
20 m] + [G-E) — 20. n + (-in — (i) 
t 2--)u — G--)m — CE + 20. — m + (01 
= 2: 2n + C: m] + [72638 + (hn + (Ihm 
＋ 20/01 (n — (jm +2 -k)i — (. n - (Hint 
20 % n + Cm} (45) 
where 7;;, is the observed mean of treatment (ijk). 


A WORKED EXAMPLE 


This expression may be simplified somewhat by putting 


(SD 


and collecting terms, thus: 


= ZW +W) 


(SE) 


£ 7 3(W’ 4- 2W) 


Pije = rut + A — Hd = Gn = Gn] 
+ (J.) + 207%) n — (m! 
T [CH = n 20 in 
All- — Gj-)u + 2G] 
+ [7 Gk) + 20 — G-E)m] 
+ [23k — (n — (m! 


The same formulas as for the prime case may easily be shown to hold 
for the variance of treatment differences. "There follows a worked 
example. 


23.10.4 A Worked Example 
The yields for the 3-dimensional lattice for 27 treatments are given in 
Table 23.12. 


13.9 (212) 
8.7 (213) 
10.4 (333) 
11.1 (311) 
12.0 (232) 
11,1 (131) 
10.5 (322) 
8.4 (123) 
11.8 (321) 


'The 


TABLE 23.12 YIBLDS or 3-DiMENSIONAL LATTICE EXPERIMENT 


Replicate I 
12.1 (112) 
11.2 (313) 
10.5 (113) 
13.0 (211) 
19.4 (132) 
10.0 (231) 
10.4 (222) 
8.8 (323) 
10.9 (121) 


13.1 (312) 
14.4 (113) 
9.7 (233) 
9.2 (111) 
12.4 (332) 
8.5 (331) 
8.5 (122) 
6.5 (223) 
7.4 221) 


9.2 (131) 
12.3 (221) 
8.1 (233) 
8.8 (322) 
4.2 (132) 
9.4 (212) 
6.4 (113) 
5.5 (313) 
5.9 (321) 


Replicate IT 
11.1 (111) 
10.8 (211) 
11.3 (223) 
10.7 (332) 
11.3 (122) 

6.1 (232) 
9.2 (123) 
6.9 (333) 
3.0 (311) 


9.6 (121) 
11.1 (231) 
10.4 (213) 

9.3 (312) 
10.9 (112) 

8.3 (222) 

6.9 (133) 

4.5 (323) 
4.8 (831) 


10.3 (133) 
11.2 (113) 
10.3 (331) 
9.2 (232) 
7.9 (223) 
11.6 (121) 
8.2 (311) 
9.4 (212) 
6.1 (321) 


Replicate II 


8.1 (131) 
10.4 (112) 
10.8 (333) 
10.9 (231) 

8.6 (222) 

9.9 (122) 
10.5 (313) 

8.0 (213) 

8.4 (323) 


479 


(46) 


11.1 (132) 
10.0 (111) 
10.8 (332) 
11.4 (233) 
10.0 (221) 
10.6 (123) 
9.9 (312) 
10.7 (211) 
7.7 (322) 


computations are based on equations 45 and 46 and set out in 
order, each item being easily identified. The only difference between 
the formulas and the computed values is that totals rather than means 
are obtained. Thus the first three tables in each of the columns are 
2-way tables, obtained by summing on the treatment digit omitted. 
The labeling of replicates is very important, as it provides the basis for 
combining the 2-way tables of sums (Table 23.13). 


TABLE 23.13 COMPUTATIONS FOR 3-DIMENSIONAL LATTICE 


LATTICE: DESIGNS 
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SV 9L = CZ'SCL + OS FE — 28 88 = 
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TABLE 23.14 ANALYSIS OF VARIANCE 


Sum of Mean 
Due to af Squares Square 
Replicates 2 85.48 
Blocks 
Component a 6 34.94 
Component b 6 65.47 
Component c 12 75.45 
Total for blocks 24 175.86 7.328 
Treatments 26 115.45 
Error 28 107.63 3.844 
Total 80 484.42 
From the mean squares, we compute 
w = 0.260, w' = 0.110 
and, hence, 
À = 0.104, 4 = 0.079 
and | 


^ — u = 0.025 


To compute the adjustments we note that equation 46 is in terms of 
means, but it is simpler to adjust the observed treatment total. Since 
we have computed totals, for example, of [2(7- -)r — (2:-)n — GU. ), 
and not means, the multiplier of the total is (A — u)/K?, and this gives 
the correction to the treatment mean. The correction to the total is 
therefore obtained by multiplying the total [2(7- -); — (2--)n — (i++), 
for example, by 30 — / &. Similarly, to obtain the » correction, 
we multiply the computed 2-way interaction tables by 3u/k. Now 
30 — u)/k? = (8 X 0.025)/9 = 0.008, and 3% = (3 X 0.079)/3 = 
0.079, so that these are the multipliers for the corresponding tables. 
In this way we obtain the adjustments (Table 23.15). 


TABLE 23,15 TABLE or ADJUSTMENTS TO OBSERVED TREATMENT TOTALS 
i " i 
i 1 2 3 T4 2 3 k 1 2 3 


1 +0.07 -—0.50 +0.18 1 -1.0 -1.49 —1.31 1 +0.09 —0.50 +2.26 
2 +0.79 +0.25 —0.47 2 —0.47 -0.33 +0.36 2 +1.47 +1.26 70.54 
3 —0.32 +0.47 —0.80 3 —0.38 —2.80 -0.54 3 +1.61 -0.58 42.08 


1 +0.01 
2 -0.14 
3 


-0.33 
-0.01 
—0.49 +0.16 
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'There are 6 correction terms for each total, those for (123), for ex- 
ample, being —0.50 + 0.36 + 1.61 + 0.30 — 0.01 + 0.16. 
We may combine the 7, 7, k adjustments with the 2-way tables (Table 
23.16). 
TABLE 23.16 COMBINED TABLE OF ADJUSTMENTS 
j k i 
me's 2 3 Ju 2 3 Eu 2 3 
1 +0.37 —0.20 +0.48 1.34 -1.82 —1.04 1 +0.10 —0.49 —2.27 


1 
2 +0.86 +0.32 —0.40 2 —0.38 —0.34 +0.35 2 +1.33 +1.12 +0.40 
3 +0.11 70.90 —0.37 3 —0.87 —3.29 —1.03 3 +1.77 —0.42 +2.24 


The adjustment for treatment (123) is now —0.20 + 0.35 + 1.77, for 


example. 
TABLE 23.17 TREATMENT TOTALS 


111 30.3 29.43 211 34.5 33.53 31¹ 22.3 23.34 
112 33.4 33.28 212 32.7 32.86 312 32.3 30.99 
113 32.0 32.50 213 27.1 25.90 313 27.2 27.91 
121 32.1 31.62 221 29.7 29.15 321 23.8 26.59 
122 29.7 30.49 222 27.3 28.40 322 27.0 27.96 
123 28.2 30.12 223 35.7 25.95 323 21.7 25.19 
131 . 28.4 28.11 231 32.0 30.24 331 23.6 24.63 
132 34.7 33.22 232 27.3 24.78 332 33.9 30.64 
133 27.7 28.92 233 29.2 27.35 . 333 28.1 28.94 


Total 781.9 781.99 
Variance of differences of treatment means: 


The treatments having 2 digits in common 


2/441 4 4 ) 
= -| — + —— + — _} = 3.013 
ee D 0.630 t 0.780 


9 
The treatments having one digit in common 
2/ 2 5 2 0 
= -| — + —— + —_ ] = 3.259 
11 5 " 0.630 0.780 


The treatments having no digits in common 


7 3 3 ) 
EN et te 82 
9 (cus + 0.630 0.780 


Average variance of treatment differences 


4 
" Du FR Sn 5) = 5 (20.902) = 3.216 
26 (0480 0.630 0.780/ 26 
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FURTHER NOTES 


In this and previous chapters, we have used the rule that, if w/w’ is found to be 
less than unity in a particular experiment, the value of unity should be used. This 
is not strictly correct on the basis of the finite model, but we have conformed to the 
literature in the matter. The use of unity in such instances can possibly be justified 
on the basis of the effects of errors in the estimation of the weights. Under infinite 
model theory, of course, W’ cannot be greater than W. ' 


CHAPTER 24 


Lattice Designs 


with Two Restrictions ' 


In Chapter 22 we described briefly designs for k? treatments, in which 
the randomization of the treatments was restricted in 2 ways, that the 
rows of the experimental material should contain specified groups of 
the treatments and also that the columns should contain specified 
groups. By rows and columns we mean the 2 orthogonal ways in which 
the experimental units are grouped, and, in a field experiment, they will 
correspond to rows and columns of plots in k X k squares. The purpose 
of the present chapter is to give a detailed discussion of such designs. 

uU N 


24.1 THE COMPLETELY BALANCED LATTICE SQUARE 


We first consider the case when k is a prime, say, p. Then the (p? — 1) 
treatment degrees of freedom may be partitioned into (p + 1) sets of 
(p — 1) degrees of freedom, denoted by A, B, AB, AB?, . ., ABP}, 
where a and b are two p-level factors used to designate the treatments. 
Clearly in any one square we may confound any one of these sets of 
(p — 1) degrees of freedom with rows, and any one with columns. If 
each of these sets of (p — 1) degrees of freedom is confounded with the 
rows of one replicate and with the columns of one replicate, the set of 
(p + 1) replicates is known as a completely balanced lattice square. 
The (p + 1) replicates form a balanced design, in that every treatment, 
occurs with every other in one row and also in one column. For ex- 
ample, with p = 5, we may have the following 3 replicates, and another 
3 replicates obtained by interchanging rows and columns: 


With rows: A AB ABS 
Confounded 

With columns: B AB? AB‘ 
00 01 02 03 04 00 41 32 23 M 00 21 42 13 34 
10 11 12 13 14 24 10 01 42 33 44 10 31 02 23 
20 21 22 23 24 43 34 20 11 02 33 04 20 41 12 
30 31 32 33 34 12 03 44 30 21 22 43 14 30 01 
40 41 42 43 44 31 22 13 04 40 11 32 03 24 40 
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The reader should verify the balanced property mentioned above. 
Formally there are several such designs, for we could use the following 


confounding, for example: 
Replicate 


I II III IV ¥ VI 


Confound with rows A AB AB* AB‘ AB B 
Confound with columns AB B AB! AB? A AB? 


This second design is, however, of equal value with the first under the 
additive model, and the one can be obtained from the other by a per- 
mutation of the allocation of treatments to the symbols (ij). 

The model which is assumed with such designs is 


Vk = M + Tij Hre T p+H yter ` (1) 


where 7, j are the levels of the factors, k is the replicate number, m is a 
constant contribution, 7,; is the contribution of treatment (ij), ry is the 
effect of the kth replicate, p is an error common to the plots of a row in 
the replicate, is an error common to the plots of a column in the rep- 
licate, and e is an error individual to the plot. It is assumed that the 
ois, y's, and e's are uncorrelated and distributed around zero with vari- 
ances c?,, ce, and c?, respectively. 

"This model may be reparametrized by the use of the symbols A, B, 
AB, , AB?~', with superscripts running from 0 to p — 1, as in all 
our discussions of prime-power factorial systems. The estimation of the 
new parameters is very simple, and we shall use the second design above 
for purposes of discussion. "The effect A is confounded with rows in 
replicate I and with columns in replicate V and is unconfounded with 
rows or columns in the other replicates. When an effect is confounded 
with rows in a replicate, a comparison of the levels of the factor, say, 
A; — Aj, is estimated in that replicate by the same comparison of the 
row means, and has an error containing the difference of 2 p's plus 4 of 
(the sum of 5 e’s minus the sum of 5 e's), and, therefore, has a variance 
of 3§(7 + 5c*,). Similarly, when confounded in a replicate with col- 
umns, the estimate from that replicate will be the same function of the 
column means, and will have a variance of 26 + 50%. When un- 
confounded in a replicate, that replicate will give an estimate with a 
variance of 30”. If then Ar, Ar, «++, Ayr denotes the estimates of a 
particular comparison of the levels of the factor a in each of the 6 repli- 
cates, and if we know c*, , and o°., the best linear unbiased estimate 
of the comparison of the true yields from the whole experiment is 
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2 W, AI + W-Ay + W(An + Am + Arv + Avi) 


4 
W, + . T 4W (2) 
where i 
W, 
e? + 50°, 
1 
Wie 
e + se. n 
and 
1 
W = -3 


If we denote the total for the comparison over all replicates by Ar, this 
may be written 
Ar (W, — W) 


+ ——— 7. (641 — Ar) 


AI x 
6 6(W,+ We +4W) 


(e — W) 
+ SO, +W. + AW) (64 — Ar) (3) 


Similarly, for the best estimate of any B comparison, we have 


Br (W, — W) 
Brig DOR NUSOEEN - 
6 | OW, + We T 4W) gba e Be) 
ite W) 


8 SV, + W. FAW) (6Bu — Br) (4) 
and so on. Combining the estimates of the effects and interactions, we 
find that the estimates of the treatment yields measured about the ob- 
served mean are very simply obtained by calculating a correction for 
each row and each column of the 6 squares, and adding to the observed 
mean the particular corrections for the rows and columns in which the 
constituent yields of the observed mean lie. The correction for any 
plots of a particular row is equal to 


(w. — W) 6 X sum of row — sum of total yields for the 
— | whole experiment of the treatments occurring in 
30(W, + We + 4W) \ that row ; 


and for a column is equal to 


(We - W) icd 


— — — — | the whol iment of the treatments occur- 
30W, + W. 4- 4W) e whole experi 


ring in that column 


488 LATTICE DESIGNS WITH TWO RESTRICTIONS 


In the case of a completely balanced k X k lattice square, k of course 
being a prime or a power of a prime, the corrections to be applied are: 
For a particular row, 


(W. — W) (k + 1) X sum of row — sum 
E — L | of total yields of treatments| . (5) 
* + D[W, + We + (k — DW] |in the row 


and, for a particular column, 

a (k + 1) X sum of column — 
vet dual ARN UEM sum of total yields of treat-| (6) 
k(k + DIW. + We + (k — DW] | ments in the column 


The above are corrections to be applied to the mean of the observed 
yields of the particular treatment. The corrections to the total of the 
‘observed yields of a treatment are obtained by multiplying them by 
(k + 1). 


If we put ; 
(Ww EY W,) A 
d *, ＋ W. + (k ES DW] " 7 
vi W -W3 T 
H 


KW, T W+ = D 
the total correction to the total of the observed yields is equal to 
A[ (observed total) + (sum of all yields) 
— (k + 1)(sum of all rows containing the treatments)] 
+ ulk (observed total) + (sum of all yields) 
— (k + 1) (sum of all columns containing the treatment)! (8) 


because every other treatment occurs in a row once with a particular 
treatment. 
The analysis of variance may be calculated by noting that the quan- 
tities 
R, = (k + 1) X sum of row — sum of total yields of treatments occur- 
ring in the row 


do not contain any treatment effects, but contain row errors and also 
column errors from the replicate in which the treatments in that row 
occupy a column, and the sum of squares within replicates has an ex- 
pectation involving o°, , and a°.. The quantities 
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Ra = (k — 1) X sum of row — sum of total yields of treatments occur- 
ring in the row over replicates in which this set of treatments 
does not lie entirely in one row or one column 


contain no treatment effects or column errors, and the sum of squares 
over all rows within replicates of this quantity has an expectation in- 
volving c? and o”,. Similar considerations hold for the columns, in that 
the quantities 


C, = (k + 1) X sum of column — sum of total yields of treatments oc- 
curring in that column , 


involve plot, row, and column errors, whereas the quantities 


C, = (k — 1) X sum of column — sum of total yields of treatments oc- 
curring in that column over replicates in which the set of treat- 
ments iri the column do not lie entirely in one row or in one 
column 


involve plot and column errors. Furthermore, the quantities are com- 
parisons such that any R; and Cn are orthogonal as regards plot errors, 
and Re and C, are orthogonal as regards plot errors. The sum of squares 
of deviations of the quantities Re within replicates gives the sum of 
squares for rows eliminating treatments, and of Rer the sum of squares 
for rows eliminating columns and treatments, and likewise for the quan- 
tities C, and Cre 

We have, therefore, the two versions of the analysis of variance given 
in Table 24.1. j 


TABLE 24.1 STRUCTURE OF ANALYSIS OF VARIANCE FOR COMPLETELY BALANCED 
LATTICE SQUARE 


Due to df Due to 
Squares k Squares 
Rows eliminating treatments k-i Rows eliminating columns and 
treatments 

Columns eliminating row and Columns eliminating treat- 
treatments * —1 ments 

Treatments ignoring rows and Treatments ignoring rows and 
columns Ej —1 columns 

Error (within row and column) (K — 290 —1) Error (within row and column) 

(k+) —1 


These two forms of the analysis of variance may be obtained directly 
from general linear hypothesis theory regarding the row and column 
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errors as fixed constants. They are, however, simply represented by 
the use of the factorial notation, in which we exhibit clearly the orthog- 
onality of the sums of squares. For the case of the design we are dis- 
cussing, namely: 

Square 


DUE CHILD "Y. VI 


Confounded with rows A AB AB? AB* AB B, 
Confounded with columns AB B AB‘ AB! A AB? 


the left-hand analysis of variance may be written as in Table 24.2. 


TABLE 24.2 

df 

Squares E 

Rows eliminating treatments 
A [ Ivrest] 
B [VI v rest] 
AB [ II v rest] 
AB? [III v rest] 
AB? | V v rest] 
AB* (IV v rest] 


Columns eliminating rows and treatments 
A [Vv II, III, IV, vy 
B [IIv I, III, IV, V] 
AB | IvIII, IV, V, VI] 
AB'[VIv I, II, IV, V] 
AB'[IVv I, II, III, vn 
AB'(IHIv I, II, V, vn 


— AAAA 


Treatments: (A, B, AB, AB*, AB’, AB‘) 24 


Error 
A X II, III, IV, VI 12 
B X I, III, IV, V 12 
ete. 1172 


Total 149 


The right-hand analysis of variance is given in Table 24.3. 
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TABLE 24.3 


df 
Squares 8 5 as in other analysis 


Rows eliminating columns and treatments 
A [ Iv II, III, IV, VII 
B {Vie LIIL IV, V) 
AB HH IV, V, VE 
AB  (IIIv I, II, IV, V] 
AB'[V» I, II, III, VI] 
AB'[IVv I, IL V, VI] 


ed 


Columns eliminating treatments 


A [Vovrest] 4 
B III vrest] 4 
AB [ Iv rest] 4| 24 
AB? [VI v rest] 4 
AB? (IV v rest] 1 
AB* [II v rest] 4 


deer al as in other analysis 


Total 149 


A quantity such as A[V v rest] is to be interpreted as the interaction 
of the A effect, with replicate V and replicates I, II, III, IV, and VI 
lumped together; a quantity A[Iv II, III, IV, VI] as the interaction of the 
A effect with replicate I and replicates IT, III, IV, and VI lumped together. 

The necessary quantities are simply tabulated, given the experimental 
yields arranged according to the field plan. The steps in the computa- 
tional procedure are: 


1. Compute the row and column totals for each square and place at 
corresponding margins. 

2. Compute the totals for each treatment over the whole experiment. 

3. Form at each row margin (k + 1) X row total — total of all treat- 
ments occurring in the row: call these Ri 

4. Also form at row margin: k X row total + total of column with 
same treatments in another square — total of all treatments occurring 
in the row: call these Ree. : 

5. Obtain likewise for columns the quantities C.. 

6. Obtain likewise for columns the quantities C+. 

7. Obtain sum of squares for rows eliminating treatments as the 
sum of squares within squares (i.e., replicates) of the quantities R, with 
a divisor of k*(k + 1). 
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8. Obtain the sum of squares for columns eliminating rows and col- 
umns, as the sum of squares within squares of the quantities C,,, with 
a divisor of K(k * J). 

9. Obtain likewise the sum of squares for columns eliminating treat- 
ments from the C.. 

10. Obtain the sum of squares for rows eliminating columns and 
treatments from the Ret. 

11. Obtain the sum of squares for squares and treatments and error 
in the usual way, these being the same for both analyses of variance. 


The computational procedure given by Yates,’ and also described with 
a worked example by Cochran and Cox,? is somewhat simpler computa- 
tionally but does not exhibit clearly the structure of the analysis. 


24.1.1 The Estimation of the Weights 
In the present case we must find 3 weights: 


d 1: 1 
W=— W,2———— and .- 
o? T P + ko, * 0 
The expectation of the within-row-and-column error mean square E, say, 
is c?, so that W is estimated by 1/E. The expectation of the sum of 
. Squares for rows eliminating columns and treatments R, say, is found 
" x k—1 
in the usual way to be equal to c? 4- =) o, as may be noted 
by using the formula of the previous chapter and regarding rows as 
blocks (ignoring the square in which an effect is confounded with 
columns). Similarly, the expectation of the mean square for columns 


eliminating rows and treatments, C, say, is equal to c? + =) ke?.. 


` As estimates for W, and W., we may then use 


k—1 
OPAR = E 
and > 9 
"nd" (9) 
MES icr 
so that S 
1 (R — E(kC — E) 
(k — 1)(KPRC — E?) 
and (10) 


p = Ae c BOR B 
(k — c- E)? 
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24.1.2 The Variance of Treatment Comparisons 


The variance of a treatment comparison may be obtained by express- 
ing the comparison in terms of the symbols A, B, AB, etc. Because 
each effect and interaction is equally confounded, namely, once with 
rows and once with columns, the variance of any effect or interaction 
comparison, of the form A; — A; or AB; — AB,, ete., is 


2 1 
k EX ar 
and the variance of any treatment difference is, therefore, 
2 
W,+W.+ = Ww 


and this is also the average variance of treatment comparisons. This 


) 0 morta. 


(11) 


E 
k+1 
The completely balanced lattice square may. be analyzed as a design 


with (k + 1) randomized blocks of k? plots, for the following relations 
hold: 


1. The expectation of the mean square for rows eliminating columns 


k? 1 
and treatments is c? + (X) o, + ( Yi -) A. 


2. The expectation of the randomized block analysis error mean 
square, that is, of the mean square óbtained by pooling the sums of 
squares for rows eliminating columns and treatments, for columns elimi- 
nating treatments, and for error (within row and column), is 


note) 
2 e 
"ES )^* pa 
3. The expectation of the mean square for treatments ignoring rows 
and columns where the 7;;'s are true treatment yields is 


k ( k ) 1 p 
r Y w-rJ 

a ee 9. o 
The reader should have little difficulty verifying these statements, by 
examining the constituents of the analysis of variance in factorial form. 
It will also be seen that the error sum of squares is homogeneous. The 
whole experiment may then be analyzed as one in complete randomized 
blocks. 


variance is estimated by ( 
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The efficiency of the lattice square design to the complete randomized 
block design is then 


2 k k 
Serre se —— e$, 2) 
cu tna Spr NI 


2 
5 
c? ko, c? . ke?, e? 
or 
1 k-1 1 1 ) : 

—— (— + — + —)[(k& -1)W+W,4+W, 12 

550 s . e) e- v w. H v am 
This may be evaluated, of course, in several ways, i.e., by estimating W, 
W,, and W, and inserting the estimated values, or by comparing the 
mean variance of treatment differences for the lattice with the mean 
variance of treatments actually obtained in a randomized block analy- 
sis. The methods will not give identical results because of the use of the 
two forms of the analysis of variance to obtain estimates of the weights. 


24.1.3 The Effects of Inaccuracies in the Weights 

To estimate the effect of inaccuracies in the weights, it is necessary to 
assume normality of all the errors. 

An examination of the loss in information in the case of the completely 
balanced lattice square is, however, rendered difficult by the fact that 
there are 3 weights, W, We, and W, and that the estimates we have 
used for o°, (c? + po’), and (c? + pc?;) are not independent. The de- 
pendence between ó? and (9 + po”), say, is easily obtained, but the 
dependence between these and (s? + pos.) is very complicated. We 
rely, therefore, on an investigation made for the case of the partially 
balanced lattice square described below. This case is easy, since, from 
Cochran’s theorem, the partition into the analysis of variance shows the 
statistical independence of the mean squares under the normality as- 
sumptions. It was shown by Yates! that the loss of information is 
negligible compared with the gains in efficiency obtained by the use of 
the lattice square design and analysis. 


24.2 THE DESIGN AND ANALYSIS OF OTHER LATTICE 
SQUARES 


There is no difficulty in extending the above method of design and 
analysis to a lattice square design that is not balanced: that is, one in 
which each effect and interaction is not confounded equally frequently 
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with rows and columns. It is possible to have all possibilities from a set 
of 2 squares only to a completely balanced set of k +1, when k is a 
prime or a power of a prime. 

As an example, we will discuss the use of only 2 squares. Such an un- 
balanced lattice square design could well be of value for the comparison 
of 49 treatments, though the sensitivity (cf. Chapter 12) of such an ex- 
periment would be rather low. We would plan the experiment so that 
no effect or interaction is confounded with rows in one replicate and 
also with columns in another replicate, for reasons that are fairly obvious 
(cf. equation 40 of Chapter 23). Suppose then that we confound effects 
and interactions in the 2 squares as follows: 


Square 
I 
I II 
Confound with rows A AB 
Confound with columns B AB 


For the case of k equal to a prime the design may be written out very 
easily, and for the case of k equal to a power of a prime one may take 
any 4 languages of the completely orthogonalized k X k Latin square. 
The adjustments to a treatment total consist of one for each row and 
column in which the treatment lies: 


For each row, the adjustment is 


LA; 
— Qqu-w Ret (13) 
k(W + W.) s 
and, for each column, the adjustment is 
(W — W.) 
—- —— C 14 
WFW) > UM 
where 
Ra = 2 X sum of row - sum of total yields of the treatments in the 
row (15) 
and 
0, = 2 X sum of column — sum of total yields of the treatments in 
the column (16) 


It should be noted that, in this design, an effect or interaction con- 
founded with rows (or columns) in one square is completely uncon- 
founded in the other square. (This is the reason why we use subscripts 
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of c and t and of r and t, respectively.) As a result, only one form of the 
analysis of variance is necessary: namely, that given in Table 24.4. 
The sum of squares for rows eliminating treatments is the sum of squares 
within squares of the quantities Res divided by 2k, and for columns 
eliminating treatments is the sum of squares within replicates of the 
Cre, divided by 2k. 


TABLE 24.4 STRUCTURE OF ANALYsIS OF VARIANCE FOR DESIGN IN TEXT 


Expectation of 
Due to df Mean Square 
Squares 1 
Rows eliminating treatments 2k — 1) o + tho’, 
Columns eliminating treatments 2(k — 1) o? + Je 
"Treatments k-i 


Error (within rows and columns) (k — 3)(k — 1) o 


Total 2* — 1 


The factor of 4 in the expectation of mean squares arises because 
each effect or interaction confounded with rows (or columns) is uncon- 
founded in the other square. The weights are estimated by equating 
observed mean squares to their expectations. 

The variance of the estimated difference of 2 treatments depends on 
their relative positions in the experiment, and the various values are: 


In a row together: 


2 1 2 k—3 
i me EL) 
In a column together: 
2 2 1 k-3 
e pon a) 12 
Not together in a row or column: 
2 2 2 * — 4 
Ar xem um) 
and the average variance of all estimated differences is equal to 
2 2 2 k-3 
TENUES TEN 7 7 igo 


As a more complicated case, suppose we have 3 replicates with the 
following confounding (such a case might arise, for instance, if several 
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replicates were removed by some experimental hazard from a com- 
pletely balanced design) : 
Square 


I Il III 


Confound with rows n 
Confound with columns B AB' AP 


The adjustments to a treatment total will consist of an adjustment for 
each row and column containing the treatment: 


For any row, the treatments of which do hot occur entirely in a column 
of another replicate, the adjustment is 


| W-W) 
kW + W,) 


For any row, the treatments of which occur in a column of another 
replicate, the adjustment is 


R. (19) 


qw 7 W,) 
k(W + W: + W;) 
For any column, the treatments of which do not occur entirely in a row 
of another replicate, the adjustment is 
(W T W.) 
k(2W + W.) 
For any column, the treatments of which oceur entirely in a row of 
another replicate, the adjustment is 


R. 20) 


(21) 


peli de CMM (22) 
k(W +W. +W») 
where 
R, = 3 X row total — the sum of the total yields of the treatments in 


the row (23) 


C, = 3 X column total — the sum of the total yields of the treatments 
in the column (24) 


In some cases the quantity Re will contain column effects, namely, when 
its divisor involves We, and, similarly, some of the C's will contain row 
effects, when the divisor contains W,. For the design we are discussing, 
the 2 forms of the analysis of variance will be necessary as in Table 24.1. 
The details of this analysis are quite mechanical in the light of the for- 
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mulation we use. Finally, for the variances of treatment differences, 
we have the following expressions: 


For 2 treatments occuring together both in a row and a column: 


70 2 4 2 tL) 
kN2W +W, 2 ＋ W. 37 


For 2 treatments occurring together in a row only: 


10 1 + 1 "t 2 +") 
kNW -W,--W., 2W+W, 27 ＋ W. 3W 


For 2 treatments occurring together in a column only: 


70 1 4 2 1 n) (25) 
k\W+W,+W. 2W+W, 2W ＋ W. 3W 


and for 2 treatments not occurring together in a row or a column: 


10 1 M 2 4 2 ttu) 
kNW --W,--W, 2W+W, 2W ＋ W. 3W 


The mean variance of all treatment differences is 


2 ( 1 + 2 fe 2 +A 
k+1\W+W,+W. 2W+W, 2W+W. 3W 


The validity of analyzing a lattice square experiment as an experi- 
ment in complete randomized blocks may be examined as in previous 
cases. If an effect (or interaction) with (k — 1) degrees of freedom is 
confounded with rows in n, replicates and with columns in n, replicates 
and is unconfounded in n, replicates, it is found that the expectation of 

the mean square for the interaction of that effect with all replicates, 
which is based on (r — 1)(k — 1) degrees of freedom, r being the total 
W of replicates, is 


J e? + ke, +“ uet, 
r r 


which is equal to the expectation of the mean square for the effect or 
interaction apart from a term involving the true effect. (In a sense, 
this is a trivially obvious property of the designs we are discussing.) 
Thus, we have the same situation as in the designs with one restriction: 
that the expectation of the treatment sum of squares is equal to the ex- 
pectation of the error sum of squares if the treatments have no effects. 
Unless, however, the design is completely balanced, i.e., n, equal to ne 
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and constant for all effects and interactions, the error mean square is 
not homogeneous under the assumed model. The lack of homogeneity 
need cause no concern in the testing of the hypothesis that treatments 
have no effect, and probably also may be ignored in the testing of com- 
parisons of 2 unadjusted treatment means. 

It is possible to obtain what is known as a semibalanced lattice square 
design for k? treatments, if k is a prime or a power of a prime which is 
odd. In this design, each effect or interaction is confounded in one only 
of the (k 4- 1)/2 replicates or squares. In that case, the mean variance 
of treatment comparisons is 


2 k+1 : k+1 
- k-1 26 
alee En] sm Cn] 


If 2 treatments occur together in a row, the variance of their esti- 
mated difference is 


2 * — 1 4 k+1 
k — k—1 
t a[w, () 2 5. + (= )r| 


and, if they occur together in a column, the variance of their estimated 
difference is 


2 k+1 h k—1 
hed oa) 


The analysis is similar to the previous cases discussed, especially the 


first unbalanced design above. 

The comparison of particular lattice square designs with complete 
randomized blocks may be performed by the usual method of compar- 
ing the mean variance of treatment differences by the lattice square 


analysis and by the randomized block analysis. 


24.3 THE NON-PRIME CASE 


Suppose we have k? treatments where k is not a prime or a power of a 
prime. Then we may, as in the case of triple lattice arrangements de- 
scribed in the previous chapter, arrange the I? treatments in a k X k 
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Latin square, and, in some cases (e.g., k = 12), we may be able to super- 
impose Greek letters to give a Graeco-Latin square. This square gives, 
as the case may be, 3, 4 (or, if letters of further alphabets can be super- 
imposed retaining the Latin square property, more) orthogonal classifi- 
cations into k groups of k treatments. Suppose these groupings are de- 
noted by o, 8, y, 5. Then we may make up a square design as follows: 


Square 
Eel AID. Xy, 
Confound with rows a B v 8 
Confound with columns Brev o8 ow 


Such a design exists for k equal to 12. For some values of k, for example, 
k equal to 6 and equal to 10, only 3 orthogonal classifications can be 
obtained, say, a (= rows of square), 8 (= columns of square), and y 
(= letters of square), and, in these cases, we may use multiples of a 
basic set of 3 replicates: 


Square 
I. H HI 
Confound with rows a 8. 
Confound with columns B y a 


We can, of course, use any number of replicates providing each of the 
3 types of confounding are represented, though, in general, it will be 
better to use the 3 replicates with equal frequencies. s 

The analysis of this design is very similar to the analysis of the triple 
lattice. The true treatment yield is denoted by rex, i denoting the a 
group, j the 8 group, and k the y group in which it lies. We use the 


identity 
Tijk = T.F (ri. — 07...) H (. E 
T (Tijk .. % r. K ＋ 2r...) 


The component (r;.. — 7...) is confounded with rows in square I and 
with columns in square III, so that, with 


1 1 1 
N. -——— 
02 + ko’, e? + ko, 


the best estimate of (Tr.. — 7...) is 
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Wali) — Ch WIG) Cn Mad.) — Clm 
W,+W.+W 
or (W — W,) 
(coo ELE 
= (i) Cn l) = Chal 
Ne c 
3(W, + We + W) 


(28) 


(21G--) — (ir — IG: — Gn 


-[G)- C0 (29) 


where [(7--) — ( r, [G-) — (h, ete., are the observed means 
on a per plot basis of (r;.. — 7...) for the 3 replicates, for replicate I, 
etc. Similar arguments apply to the other components. 

The adjusted yield as a total of 3 plots may be obtained by adding 
to the unadjusted treatment total a correction for each row and for 
each column of each square. If we put 


W-W,. W —W. 
RX * ä and u= ER CE e (30) 
k(W, + We + W) kW, + W. + W) 
the correction for each of the plots of a row is N 
and for each plot of a column is — uC, (31) 
where : 
R, = 3 X row total — the sum of the total yields of the treatments oc- 
curring in the row (32) 
and 
C, = 3 X column total — the sum of the total yields of the treatments 
occurring in the column (33) 


The analysis of variance has the structure given in Table 24.5. 


TABLE 24.5 STRUCTURE OF ANALYSES OF VARIANCE FOR UNBALANCED LATTICE 


SQUARE 
Due to df Due to 
Squares 2 Squares 
Rows eliminating columns 3(k — 1) Rows eliminating columns and 
treatments 

Columns eliminating rows and Columns eliminating treat- 

treatments 3(k — 1) ments 
"Treatments * —1 Treatments 
Error (within row and column) 20 — ) — 2) Error (within row and column) 

„ 


Total 3k -1 Total 
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The sums of squares are obtained in the same way as for the balanced 
case described above, it being necessary to form quantities Re, and C,, 
defined analogously, the divisors being 4k for rows eliminating columns 
and treatments or for columns eliminating rows and treatments, and 
6k for rows eliminating treatments or columns eliminating treatments. 
The expectation of the mean square, R, say, for rows eliminating columns 
and treatments is (c? + Vókc?,), and, for columns eliminating rows and 
treatments, C, say, is (o? + o,). As estimates for the weights, 
then, we may use w = 1/E, E being the error mean square, w, = 
1/(2R — E) and v, = 1/(2C — E). 

'The mean variance of treatment comparisons may be obtained by 
noting the following variances: 


var (f... — fy) = var (f. f.) = var (ĉe — f 
2 


Sa a (34) 
kW, + W. + W) 


and 
var [(it — f;.. F. j. f... + 26...) 
— (fv je — fy.. — f.p. — Fp + 27. ) 


2 
. TIPS 3 
sey < ) i * i, j * , k * K 
? 1 , , kæk 
= —— (k — 2); J „j =, , 3: 
zw ) 1 * i, j , k M (35) 
* i, j * K = K. 
It follows, by simple substitution, that. 
var (% — 5 
t= jr j,k zk’ 


2 2 k-2 
[—Bs nm ); ixi j=j x AN 


“ENW, +W. +W 3W Am bi 
„ 
r nl (36) 


In the comparisons of a particular treatment with all the others, there 
will be 3(k — 1) of the upper type and (k — 1)(k — 2) of the lower 
type, so that the mean variance of treatment comparisons is 


2 ( 3 +) 37) 
ETIWLSYWSokW zy f 


a result identical with the prime case. 
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944 DESIGNS WITH 2-RESTRICTIONS WHICH ARE NOT 
SQUARE 


The notion of double confounding, which was present in Chapter 15, 
may be used to develop à group of designs for p" treatments, p being 
a prime or a power of a prime, the replicate having a rectangular pat- 
tern of the form p” plots by p* plots, where r + s = n. There are ob- 
viously many cases, and it is possible and only worth while to give one 
example. No aspect of the design or analysis will be unfamiliar in the 
light of the material of the present and previous chapters. 

Suppose then that we have 32 treatments and wish to use a design 
with 2 restrictions. A correspondence of the 32 treatments to the case 
of 5 factors each at 2 levels, say, a, b, c, d, e, is set up. Any 1 replicate 
can consist of a rectangular pattern of 8 plots by 4 plots or 16 plots by 
2 plots. In the case of an 8 X 4 arrangement, we confound a set of 7 
degrees of freedom with rows and a set of 3 degrees of freedom with 
columns or vice-versa. For example, with field plots whose relative 
dimensions are 1 to 5, it might be advantageous to have replicates of 
relative dimensions 8 to 15 by such an arrangement. The following 3 
replicates are such that each effect or interaction is unconfounded with 
rows or columns in at least 1 replicate: 


I Confound with rows: A, B, AB, C, AC, BC, ABC 
Confound with columns: D, E, DE 
II Confound with rows: AB, AC, BC, AE, BE, CE, ABCE 
Confound with columns: ACD, BD, ABC 
III Confound with rows: A, BE, ABE, CD, ACD, BCDE, ABCDE 
Confound with columns: AZ, BDE, ABD 


In this case a model consisting of a mean, treatment effect, row error, 
column error, and treatment error would be used, and there would be 


3 weights: 


1 1 1 
= = ——"’ F. 
* , "eam ENTM 


The analysis, although rather intricate computationally, may be ob- 
tained by an approach identical with that used for lattice squares. 

The enumeration of designs will be greatly facilitated by the use of 
factor groups. We may note, for instance, that, if unit elements are 
added to the confounded effects and interactions, 2 groups are obtained, 
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one for rows and one for columns and that the product of these groups 
gives the whole group of effects and interactions together with a unit 
element. 


24.5 FURTHER DESIGNS 


There is a group of designs for p? treatments, where p is a prime or a 
power of a prime which is of some interest and value. They consist of 
blocks of p plots, each block being arranged according to a lattice square 
pattern, and are analogous to split-plot experiments. With the usual 
factorial notation, the scheme shown in Table 24.6 may be used. 


TABLE 24.6 
Confounded with Lattice Square 
Replicate Rows Columns Plots Split for 
I A B C 
Il [^] A B 
III B 0 4 


Information will be of 4 types: 
1 


02, + ke? + ko’, 
1 
02, + ko? + ko’. 
1 
c? T ko’, 


1. Interrow with variance proportional to W, = 
2. Intercolumn with variance proportional to W, = 
3. Intrarow and column with variance proportional to W = 


4. Intrawhole plots with variance proportional to W, = n 
s 

With such a design the variance of the A, B, and C effects will be 
l/p'(W,-- V. + W,) the variance of the interactions AB, AB?, 
AB?, AB‘,-AC, AC?, AC?, AC*, BC, BO, BC?, BC*, ete., will be 
1/p?(W + 2W,), and, for all interactions involving 3 factors, the vari- 
an Ac be 1/p?(3W,). The mean variance of varietal comparisons 
wi 


xx (38) 


z( 3 P 12 16 ) 
31\W,+W.+W, W+2W, 3W, 

The analysis will follow the general lines of the present and previous 
chapters. The weights for row comparisons, column comparisons, whole- 
plot and split-plot comparisons may be obtained from: 


1. The mean square for rows eliminating varieties and columns and 
whole plots, which is obtained from the comparison of main effects in 
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squares in which they are confounded with rows with the same main 
effects in squares in which they are unconfounded with rows, columns, 
or whole plots. 

2. The mean square for columns, eliminating varieties and rows and 
whole plots obtained likewise. 

3. The error mean square for whole plots, obtained from the compari- 
son of 2-factor interactions in the squares in which they are confounded 
with whole plots with the same interactions in the other 2 squares in 
which they are unconfounded. 

4. The split-plot error mean square, obtained from the comparison 
of 2-factor interactions among squares in which they are unconfounded, 
and the interaction of the 3-factor interactions with the 3 squares. 


This design appears to be eminently suited for corn breeding work in 
which the basic plot is long and narrow. It is customary to use plots of 
size 2 by 10 hills, and the arrangement of p of these (for small p) in a 
whole plot would result in a whole plot that is more or less square, and 
the full advantages of the Latin square control of row and column ef- 
fects would be utilizable. 

Alternative to the above split-plot design for p? varieties, we may, as 
Yates? pointed out, divide the varieties into p groups of p^ varieties 
and test each group of p? varieties with p X p lattice squares, of which 
only 2 are absolutely necessary for each group. The division into p 
groups of p? varieties may be made by choosing one effect or interaction 
to be confounded with groups in each replicate, and a large number of 
possible groupings are available. If the pseudofactors are denoted by 
a, b, c, the possible replicates are obtained by choosing one effect, or in- 
teraction to be confounded with squares and other interactions to be 
confounded with rows and columns within squares: If the factors each 
have 5 levels, for example, Table 24.7 gives 9 suitable replicates: 


Taste 24.7 
Confounded with 
Squares Rows Columns 

A B C 
A BC BC? 
A BC? BC* 
B C A 
B AC AC? 
B AC* AC* 
0 4 B 
e AB AB? 
c AB’ AB* 
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This table could be extended (1) by interchanging rows and columns 
and (2) by confounding between squares each of the possible 31 effects 
and interactions. The minimum number of replicates that must be 
used is 4, whatever the value of p, but such a design would have a low 
relative efficiency. Information in such a design consists of: 


1. Among squares. 

2. Among rows within squares. 

3. Among columns within squares. 
4. Within row and columns. 


and the relative efficiency may be evaluated in terms of the variances of 
these types of information. As stated by Yates,’ the efficiency factor 
of the design given above (the ratio of the mean variance of varietal 
comparison in complete randomized blocks to the mean variance in the 
design, when information other than within rows and columns is as- 
sumed to be valueless, and when the error variance is assumed to be 
the same in both designs) is 


(p — Dy? +p+1) 


(p + DG + p + 24) 
This factor is obtained by noting that the 3 main effects will be deter- 
mined with variance 1/(p — 1)W and the remaining (p? + p — 2) ef- 
fects and interactions with variance 2/3(p — 1)W, so that the mean 
variance of varietal comparisons would be 
ibi 3 Abe deu (p? + p + 25) | 
(p —1l(p-DW 30 — DW 3W L(p* + p+ (p — 1) 
compared with 4/3(p + 1)W with complete randomized blocks and the 
same error variance. 

A further extension is the testing of p* varieties involving pseudo- 
factors a, b, c, and d, in which factors a and b are applied in a lattice 
square arrangement, the plots being split for factors c and d, which are 
also applied in a lattice square arrangement. 
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CHAPTER 25 


Rectangular Lattices 


25.1 INTRODUCTION 


There is a class of designs, some members of which have been ex- 
amined by Harshbarger,'"? called rectangular lattices. Suppose we wish 
to test k(k — 1) treatments (k > l), in an incomplete block design. If 
k is a prime number, the only obvious factors of k(k — 1) are k and 
(k — D). This suggests that we should consider a block size of (k — H. 

An easy way to get a design in blocks of (k — J) is to arrange the 
k(k — 1) treatments in the cells of a k X k square in such a way that J 
of the cells in each row and column are not occupied, and to use rows 
and columns of the square as blocks. For example, for 3 X 2 treatments 
we arrange the treatments in a 3 X 3 square as follows: 


The treatments will be denoted by (i, j), i being the row number, and 
j the column number of the square on which the blocks are based. The 
discussion of the analysis when I= 1 is simplified by assuming that the 
cells of the square that are not occupied lie on the leading diagonal, so 
that the treatments (ii), 1 = 1, «++, k do not occur. If treatments are 
not numbered in this way, they may be renumbered easily to give this 
arrangement. Arrangements of this form, involving 2 basic replicates 
with as many repetitions as desired, are known as rectangular lattices, 
though they would better be named simple rectangular lattices to con- 
form to the usual lattice notation. : 
Three groupings of the treatments may be obtained by taking a Latin 
square and dropping out / cells in each row and column such that l of 
507 
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each letter are also dropped out. In the case of | — 1, such arrange- 
ments obviously exist for any value of k that is a prime or a power of a 
prime or odd. For, when k is a prime or a power of a prime, we can 
construct a Latin square such that the leading diagonal contains one 
letter, and any square orthogonal to this one will have the required 
property. When k is odd, we make up a square with the desired prop- 
erty merely by writing down the first row as 0, 1, 2, 3, . . ., k — 1, and 
adding 1 to each element (reducing modulo k) to give the second row, 
adding 1 to the elements of the second row to give the third row, and 
so on. In all cases in which such a square is possible, we may have the 
design known as the triple rectangular lattice. There are 3 basic rep- 
licates, in which rows, columns, and letters of the square, respectively, 
are confounded, giving blocks of (k — l) experimental units. 

In the case when k is a prime or a power of a prime, it follows, from 
general theory, and from what was said above, that we may have a 
rectangular lattice for k(k — 1) treatments in blocks of (k — 1) ex- 
perimental units with „ basic replicates. If the Ist language is such 
that the letter in the diagonal is constant, the confounding will be of 
rows, columns, 2d language, 3d language, .., (k — 1)th language, re- 
spectively, in the k replicates. d 

"There does not seem to be a great need for discussion of cases other 
than | = 1; for * — 2) = (k — 1)? + 1, so that, unless the treat- 
ments are very well defined, it is likely that one may be omitted and a 
design for (k — 1)? treatments used. For any , the number k(k — 1) 
is approximately midway between (k — 1)? and 12, and we have spent 
two chapters on designs for these numbers of treatments. The subject 
of the design of experiments can hardly be expected to deal with all 
possibilities, and the study of all possible numbers of treatments in all 
possible sizes of block would be a poor utilization of the statistician's 
time. 


25.2 THE ANALYSIS OF A SIMPLE RECTANGULAR LATTICE 
FOR k(k — 1) TREATMENTS 


The usual additive model will be used, namely, that the yield of 
treatment (ij) in block k within a particular replicate s is given by the 
equation 

Vt = p eh bi, + Tij + te Cijka (1) 


where the eggs are assumed to be uncorrelated and distributed around 
a mean of zero with constant variance o°. Apart from the matter of 
constant variance, the assumptions are justified, because the alloca- 
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tion of treatments to experimental units within the block is made ran- 
domly. If the allocation to blocks of groups of treatments which are to 
be together in a block is made randomly, and this should be done al- 
ways, we may also assume that the bis are uncorrelated and distributed 
around a mean of zero with a constant variance of . The experi- 
mental units should be chosen to have approximately constant variance 
within blocks. 

In the simple rectangular lattice, there are 2 basic replicates, and we 
shall call the X replicates those in which rows of the square are con- 
founded and the Y replicates those in which columns are confounded. 
In X replicates, therefore, k = i and, in Y replicates, k = j, so that the 
subscript k may be dropped. The true treatment effects measured 
from a mean of zero are denoted by 7;;, and we denote by p; the mean 
of the 20) in the ith row and y; the mean of the r hs in the jth column 
of the square. We note that the 208 with ? = j do not occur, so that 


1 
D. y=- En (2) 
1 112 : poign ; 


and Sop; = L = J ry = 0. We denote the mean yield from 


i j ij 
treatment (ij) in the X replicates by zi;., and in the Y replicates by 
yij., and the corresponding totals by XA. Yiz- The difficulty of the 
analysis arises from the fact that the comparisons confounded in X 
replicates are partially confounded in the Y replicates, because of the 
missing diagonal in the basic square. The estimation problem may be 
solved by assuming c? and a?» to be known. For we then have a gen- 
eral linear hypothesis on the 7,;’s, which consists of two parts, the dif- 
ferences within blocks and the differences between blocks. By virtue of 
the randomization of treatments within a block and consequent or- 
thogonality of orthogonal comparisons (given additivity, cf. Chapter 8), 
we obtain the first term of equation 3 below, and, by virtue of the ran- 
dom allocation of groups of treatments to the blocks, we obtain the 
second term of equation 3. It may be of help to recall to the reader the 
fact that, if we make up (n — 1) orthogonal comparisons of z;, 22, 
„ Tm, Say, 
n 
Dd xg i=l, n-i 
j=l 

with 


yay = 0 


j=l 
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and z 
Se NN m] if i = a 
=O of UT EM 
then, UART : 
2: Pr Na) = Z(r; — 2) 
i-1 N-1 


This fact we have used again and again, for example, in the breaking 
up of the treatment sum of squares in an ordinary randomized block 
analysis. With r repetitious of each of the basic replicates, the best 
linear unbiased estimates of the 7;;'s are obtained by minimizing, 


E x * (rijs — zia — Tij + pi)? + O (ijs i. — Tij + w] 
a 10 
(k — 1) | f 
Alo? + (k — 1) 27 — Y (zi — T.s — pi) 
+ 2 (%. — V. — | (3) 
J 
where we are supposing the same numbering of blocks within replicates 


of the same type, and, as usual, the replacement of a subscript by a dot 
denotes that a mean has been obtained over that subscript. Put 


1 1 
W = — and W’ = ——_______. 
e? c? + (k — 1)e?, 
Then, differentiating with respect to ry, and denoting estimates by 
, we get 


^ 


1 
W lc — 11. . — Fim +)(-1 til) 


+ L. (ime — me — fin, hi) S) 


m'sem 


1 
vus (Yim: —7 Vm. — fim + $n) (—1 ti) 


1 
or S (Yum. — Ym- — fun + Fm) (- x 3] 
1 
+ r(k — ) [ — K. .) — pi) (- —) 


ce ey - 4) (-—)| (4) 
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and, simplifying, we get 
TW[— (rin. — kl.. — Fin + Bt) — Yim: — Ym: — fim + Fm) 


1 
ae 6-1 2 (Zim: — 11. . — fim — Îi) 


5 3-3 2 (Yum: — Ym: — Pum. + 4m) | 
TM- Gr.. — 2. — 8) — Qm 7 V. — $89) (5) 
We note that 
S (tims. — I.. — fim + ĝi) = 0 


and 
DG. — Ym- — Fun + Fm) = 0 
v 


where, of course, m^ cannot take the value / and I’ cannot take the value 
m. 
So the equation for fun is 


—TWLGn- — t — Fim, at ĝi) ^E (Yim- n fim + In)! 


Id. — m. — B) H Ym: 7 Ye — Im) =O 6) 
or 


2rWi, — r(W = N) — r(W. — Wn 
= rW (im: — Yim: — Yt: — V-m-) 
Wn — 2. FH Ym — Ye) (7) 
This equation may be written 
TW (2fim — Zim: — Yim: +E FY) — r(W — W^ — r(W — W^)» 
-r1W(-z.-— ym T . . y) T rW'Qa-- — .. + yom ) 


= NW - Wm. — mcm = Ye) (8) 
or arm 
An = (Tim: F Vim: = £4 — V) t 77 (1 — 21. T 2. .) 
. 
fe (Fm — Vn; + Ye) (9) 


W 
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From this equation, we see that the best estimate of tim expressed 
around the general mean is equal to the mean yield under this treat- 
ment plus two corrections, say, 


j W- " d X ) W- ". 
ea = =t. tr.) = 2 
zl W i71 ZW 1 
(10) 
: N N“ - N 
C ym = ow ($m — Ym . ) 2W din 


All that remains then is to find explicit expressions for d,; and dym. If 
we add equation 9 over m, remembering that m does not take the value 
l, we get 


2(k — 1) = (k — (zi. + y.. — z... — y...) 
= N W-W' 
W (51 — zi. +2...) — 
or, after a little simplification and rearrangement, 
(k — 1)(W 6. — zi. 2.) ＋ ( — W)($ - y. y--2 
= (k GN... - . .. — I.. +2...) (11) 


+ (k — 1) (Fi — yu tye) 


or 
(k — IW + Wd + (W — Od 


-(k-—1W(t.—2z..— t... + 2x...) (12) 
where 
te. mod yi 
Similarly, 


(W - W^da + (k — 1)(W N 
= (k-—LDW(ti—2y4. — t..--2y..) (13) 


"Therefore, after adding equations 12 and 13 and then solving equations 
12 and 12 4- 13, we find 


ue - 20.4 L6 - DW -. — 2. +b... = 2...) 
W [(k — 1)(W + W^) - (W — wW’) 
(k — 1)(W — W^*(tà..— 221.. + t4. — 2y 4) 
[(k — ))(W = (W — H — D(W + W^ + (W — W^] 
(14) 
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with an expression for dy; obtained by reversing the position of l within 
the first two lower subscripts and interchanging æ and y. The adjust- 
ments to the observed total of the yields for a particular treatment (Im) 
is then c; + Cym, Where, using Tı.. to denote the sum of yields of all 
plots with a treatment whose first subscript is J, etc., and noting that 
the terms f., z..., y... drop out on summation of all the appropriate 
adjustments, we have : 


(W — )( TI. — 2X.) 
I — (W + W^) — (W — W’) 
(W — WT. — 2X1. + T4. — 2Y 4) 
(* = DW +W’) = (W -Wik — D(QW + W’) +W- W?] 
(15) 


Cai = 


( - f — 2Y-m-) 
^m = Www ( = W) 
W — WT... — 2X . + T... — 2.9 
Ic — e +W — (W — W^l& — i) r W^) + = W^] 
(16) 


25.21 The Analysis of Variance 
The structure of the analysis of variance is given in Table 25.1. 


TABLE 25.1 SrRUCTURE OF ANALYSIS OF VARIANCE FOR r REPETITIONS OF A 
SIMPLE RECTANGULAR LATTICE 


df 
Replicates 2r — 1 
Blocks eliminating treatments : 
Component a 2(r — 1)(k — 1) 
Component b 2(k — Y) 
"Treatments ignoring blocks kk —1) —1 
Error (2r — 1)k? — (Ar — Dk +1 


his gp c 
Total Qrk(k — 1) —1* 


Component a exists only when r is greater than unity. There are, 
then, r replicates of type X which have identical block structure, and 
the interaction of these block structures with the X replicates gives a 
sum of squares with (r — 1)(k — 1) degrees of freedom; similarly, 
(r — 1)(k — 1) degrees of freedom arise from the Y replicates. Compo- 
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nent a plus component b is equal to the sum of squares for blocks elimi- 
nating treatments obtained when fixed unknown block parameters are 
assumed and estimated. The intrablock estimates of the 7;;'s are ob- 
tained by putting W’ = 9, and the estimates of block effects are then 
easily obtained as the block mean minus f; or ;, as the case may be. 
The estimate of 7; is found to be 


uve] 
HEC DI — 1) (F... XI. .) - (Ka. — Y .)] (V.. . — XI. .) 


+ Y [k — K.. — F. z.) — (Yi. — XI. OX 4. — Ya) 
— (F.. Bor (17) 


The expectations of the sum of squares for the components are: 
Component a: 2(r — 1)(k — 1)e? + 2(r — 1)(k — 1)?e?, 
Component b: 2(k — 1)e? + (k — 1)?e?, 

so that the mean square for the pooled blocks eliminating treatments, B, 
say, has an expectation of c? 4- = (k — 1)o°s. The expectation 


of the error mean square E, say, is o°. The weights W and W' may, 
therefore, be estimated by the equations, 


1 
w=- 
E 
(18) 
21 — 1 
2rB — E 


25.2.2 The Variance of Treatment Comparisons 


The variance of a treatment difference is estimated by considering 
the equation 7 for the fin's. To get the variance of the estimated dif- 
ference of fim and frm, we obtain the estimate of ?j,, — frm from these 
equations with the right-hand sides changed, so that the right-hand 
side of the equation for fu is unity and for fr» is minus unity and for 
all other frm is zero (cf. Chapter 6). 

In this way we find that there are 4 types of comparisons exemplified 
by the following: 
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(712 — i 


with variance —— 


2rW. 


or 
(#21 — 731) 


È + (k - DOV N — 
A 
(712 — 723) with variance 
1 | (W — W) — 1)W + (2k — om) 
—1 4 — — 
2rW A 
(712 sx #01) with variance 
EL |i 2(W — W^((k — DO 4- W^ + (QW — W^] 
2rW 4 


G ; 1 1 [i —— D(O — mee | 
712 34) wi ess "T ^ 


| (19) 


where 


A = (k — 1*(W + ) — (W — W^? 
For most purposes the use of an average variance of treatment com- 
parisons of 
(=a) 


— — — 6k? + 7k — 2)W 
z-rzam a 


2rW | + 
+ (2k? — 6k? + 5k — m (20) 


which is virtually identical to the simpler expression 
1 | 2(k — )*(QW — W^QV + — 
2rW (8 —k- 0A 


will be satisfactory. i ; 
An examination of the effect of inaccuracies in the weights would 


proceed as in the previous chapter. No work on this has been reported, 
so far as is known. 


25.3 THE ANALYSIS OF THE TRIPLE RECTANGULAR 
LATTICE 


The procedure by which a triple rectangular lattice for k(k — 1) 
treatments will be analyzed may be derived in exactly the same manner 
as the above. Each treatment will have 3 subscripts, t, J, m, say, such 
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that 1 = m, j * m, i j. Three quantities, pi, yj, and ôm, will be de- 
fined thus: 


1 

Wee 2 Tijm (21) 
1 

j = TID » Tijm 


There are 3 types of replicate, X, Y, and Z, correspondingly. If we de- 
note yields by Tijms, Vijms OT Zijma, 8 being the replicate number, the 
equation corresponding to equation 9 is 


3Fimn Hs (Tima: + Yimn- + Zinn: T.. Youre = Biei) 


TE g 1 A facis 
y L— axe 4 — 


W-*' 


Te. — 2. „ 1 (22) 


+ 


($m — Ym t y.) 


Letting 
dia i-r. + 2... 


dym = Im — Vm / 
den = d, — 2... + 2 


corresponding to equations 11 and 12 for the simple rectangular lattice, 
we get 


(k — 1)(2W + W^d, + (W — W')dy + (W — Wda 


— (k m I). = 321... — 1 . — des) 
(W — W^5d; + (k — 1)(2W + W^dy + (W — Wd (23) 
= (k — 1)W (t. — 3. — t... — By...-) 


(W — W')da + (W — W^dy + (k — 1)(2W + 0d. 
ee e 


where ti... = zi... + . 2 etc., and, adding these three equa- 
tions, we have 


[(k — 1)(2W + W^) + (W — W^)(dz + dy + dii) 
-D — 32. t. 3 C4: — 384). (04) 
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The adjustment to the observed total yield under treatment (ijm) is then 
r(W — W’) 

TO 


r being the number of times each X, Y, and Z replicate is repeated. 
From the above equations, we find that 
( — W’) (W — W’)(T;.-. — 3X;...) 


w  " [k-—nDQW-4W)-(Qw- 0 
[qw - W'*T;...— 3X... + T... — 3Y 4- 


(dzi + dy; t dm) (25) 


| Niere RE) cin 
[ik — DQW + W’) — QV - Wl — D) QW + W’) | 
4- 2(W — W’) 


where X;..., ete., are totals and T;... = X5. Y. ae a with 
a 


From the point of view of computation, as given by Cochran and 
Cox,? we note that 


corresponding expressions for 7 77 ) ay and r( 


D BR ei 


is equal to the total over the whole experiment of treatments appearing 
in block i of the X replicates minus 3 times the total over the X repli- 
cates of the ith block totals. If we denote these quantities by Cz; and 
use corresponding quantities for the blocks of the other replicates, that 
is, let 

Cy = T. . — BY 4 
and 


G. tw (27) 


and also let 


8. = Ca Cyi T Cu 


the adjustment to the observed total yield is 


(Cz; — uS) + (Cy i + (AC — un) (28) 
where 5 Co 
X (k — 1)(2W + W’) — (- N (2 — 3)W + kW 
and a E w-w) (29) 
WwW — W^) X 


en- ＋ W)-2W-W) 2W-(-39W 
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The analysis of variance is evaluated directly as in Table 25.2. 


TaBLE 25.2 STRUCTURE OF ÁNALYSIS OF VARIANCE WITH r REPETITIONS OF 
TRIPLE RECTANGULAR LATTICE 


Mean Ezpectation of. 

Due to df Square Mean Square 
Replicates 8r-1 
Blocks component a 3(r — 1)(k — 1) 1 7 — 1 DENS. 
Blocks component b 3(k — 1) } jJ 77755 ( 3r iie 
Treatments ignoring blocks * — 9 — 1 
Error (3 — Di — (67 — Dk 1 E a 

Total Srk(k—1)—1 


Blocks component a is obtained in the usual way as the interaction of 
blocks and replicates with the same block arrangement. Blocks com- 
ponent b is obtained by noting that the intrablock estimates of das, 
etc., are given by 


1 1 
A t. 
Raw M ammo. 


The estimates of block parameters are, therefore, of the form 
da. = pı — 11 FT 


and so on, so that the sum of squares between blocks eliminating treat- 
ments is Zd,;, (block total — sum of treatment means for whole ex- 
periment of treatments occurring in the block) (ef. Chapter 6). 

The sum of squares for component b is then found to be equal to 


Z(C?,; + C?,; + C?) 


EIE *(ze)«(zeJ] 


1 
- 3r(2k — 3)2k (x S ) m) 
It should be noted that r in all the formulas given is the number of 
repetitions of the basic pattern of 3 replicates and not the total number 
of replicates. 
The expectation of the total sum of squares for blocks eliminating 
treatments is equal to 


3r(k — 1) [^ a = (k — A 


3r(2k — 3) 
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The weights may, therefore, be estimated by * 


(31) 


25.4 THE VARIANCE OF TREATMENT DIFFERENCES FOR 
A TRIPLE RECTANGULAR LATTICE 


The true variances of estimated treatment differences are obtained by 
considering the original least squares equations, obtained by differenti- 
ating the sum of squares of deviations (cf. Chapter 6). To obtain the 
variance of (Pian — flim'n'), we must solve the following equations: 


Zr en, — r(W — N) — r(W — N — r(W — W'ó, = 1 
8rWermnr — r(W — W')By — r(W — Wiw — r(W — W')iy = —1 
and 
ry enn — r(W WO) — r(W — .) — r(W — Hon. = 0 
(32) 
for all (Ii, mi, nı) unequal to (l, m, n) or (,, m', n’). The estimate of 
Timn — Ti'm'n’ is equal to 


2 
"m ) 


cM 8 — fy tn — fur . „ — ov 33 
3 3W (&i — Bv + 1m — 7 ) (33) 


and this is the variance of the estimated difference fi — frmn' 
Summing the equations 32 in the suitable way, we obtain the 3 
equations: 
afi + Bw: + Bêr = ôw — Suv 


Bove + afv + Bêr = on, — mv (34) 
Bove + Bove + adr = Bur — One 
where ôn» is the Kronecker delta, which takes the value of unity if 


the 2 subscripts are the same, and zero if they are different, and 


* It is shown by P. M. Grundy, Biometrics, 6 (1950), 25-33, that this procedure 
for estimating the weights will in most cases lead to estimates of the variances 
(1/W, 1/W’) which have minimum variance in the class of estimates obtained by 
linear functions of the mean squares. 
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a = r(k — 1)(2W + W^) and 8 = r(W — W^). The solution of these 
equations is: é 


bur = (hw = rw) — PEET ( — rur + mv 
— ôm + ôn’ — on 
dis = —5 . 5 , 
= bmi F on — dn 35) 
5 = (nier — B) — — (u, — d, + ôm” 
a—B (a — B)(a + 28) 


— öm + 8,1, — Bnet”) 


Finally, we may write, for the variance of the estimate bun — fru, 
the expression: 


AE Ia ESOFA = SES TIENE WAT 
3rW 3W Mae 8 u^ mm^" nn 


28 
€—— (1 Bip) + (1 „%) -- (1 — San 
(a — 8)(a + 28) K ex t) ! 


— Uy. — tn: dl bm = bn 7E Ômn' -a in| (36) 


since Sim, Bins Smns bum’, Suny, and onen! are zero. 
We, therefore, find the following variances: 


The 2 Treatments Occurring Together in a Block: 
2 * — 2)W — 4)W’ 
1 subscript alike: —— L T eee 
3rW 4 


2 ka Syn- 
2 subseripts alike: —— |i + em] 
3rW 


4 


2 4kW — 6)W’ 
3 subscripts alike: —— fi + Sao) 
3rW 
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The 2 Treatments not Occurring Together in a. Block: 


2 6k — 3)W — 4 
0 subscripts alike: —— [ + ed 


Zy N 4 
1 ec liar RE [ P cme 
: Zr A 
2 —1)W — SW' 
2 subscripts alike: —— | t ——— 
37 A 
2 6kW + (3k — 9)W' 
3 subscripts alike: —— |: + TO 
3rW 4 


where 
_ (a — B)(a + 28) [2k — 3)W + KW'J2kW + (k ). 
6 = f N 
In general, the variances within a group will differ by little, so that. 
to get an approximate average variance, we may assume that 3(k — 2) 
comparisons of a treatment with treatments occurring with it in a block 
have a variance of 


1 4k — 2)W + (2k — 4)W’ 
1 [i me 9m] Gn 
3rW A 
and (k? — 4k + 5) have a variance of 
— 3)W + (3k — 69W" 
zl B (6k — 3W + ( ) | (38) 
3rW A 
This gives an average variance of 
2 4 = M. 
ssl 3(k — 1)? 2(k — DW + (k - 2)W (39) 
3rW (k? —k — 1) A 


As with all lattice designs, we may estimate the error variance to 
which the yields would have been subject, with complete randomized 
blocks, and hence the efficiency of the incomplete block arrangement. 
This is done by combinirig the sums of squares for blocks eliminating 
treatments and for error. The resulting mean square is an estimate of 
the variance in complete randomized blocks, and the mean estimated 
variance of treatment comparisons would be 2/3r times this quantity. 
For, if treatments are completely randomized over blocks within a rep- 
licate, of the possible k(k — 1)[k(k — 1) — 1] positions taken by the 
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pair of treatments, k(k — 1)(k — 2) will not involve block differences, 
but the remainder will do so. The average variance is then 


1 2 
n e e- 0 
+ [k(k — 1)(k? — k — 1) — k(k — 1)(k — 2) (e? + 289] 
a- , 
-2[à ue 


It is readily verified that the expectation of the pooled mean square E“ 
is equal to 


(k — 1)? 
(-k-1. 


The efficiency of the lattice arrangement is then estimated by com- 
paring the actual mean variance with the estimated mean variance with 


c? + b 


2 
randomized blocks: namely, — E“. 
r 


25.5 AN EXAMPLE OF A TRIPLE RECTANGULAR LATTICE 


The experiment in Table 25.3 was constructed from random normal 
deviates using values of unity for c? and o°, and a mean value of 10, 
treatment numbers being in parentheses. 


TABLE 25.3 


Block X Replicate 

8.9 (182) 10.0 (143) 11.6 (124) 
9.4 (314) 9.3 (342) 10.2 (321) 
9.6 (213) 11.4 (234) 10.0 (241) 
11.8 (412) 11.7 (431) 13.1 (423) 


Y Replicate 
11.6 (132) 12.4 (431) 10.0 (234) 
9.6 (314) 10.0(412) 8.4 (213) 
10.5 (124) 11.0 (321) 10.0 (423) 
11.5 (143) 12.6 (342) 11.8 (241) 


Z Replicate 


2 11.2 (132) 12.1(342) 9.7 (412) 
3 7.8 (143) 9.6 (423) 10.6 (213) 
1 
4 


»- t0 


2 2 0 


8.7 (431) 9.132) 8.0 (241) 
8.7 (120 7.5 (310 8.3 (234) 
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We find the following: 


One n 

2 

e 

2 

ao 
28 8 8 5 
* D ia 


Total | 127.0 | 129.4 | 111.3 


(ijk) | 124 mE 213 241 | 314 des 412 | 423 | 431 
Tiik | 30.8 | 81.7 28.6 a7 29.8 | 26.5 x5 34.0 | 31.5 | 32.7 | 32.8 || 367.7 


TABLE 25.4 
i TS T. Tu Cu Cys Cu Si 
1 91.8 86.6 92.9 0.3 2.6 15.5 18.4 
2 88.1 93.8 97.2 —4.9 —0.7 —1.8 —7.4 
3 90.8 94.2 90.6 4.1 —7.8 6.6 2.9 
4 97.0 93.1 87.0 —12.8 —14.6 13.5 —13.9 


367.7 367.7 367.7 —13.3 —20.5 33.8 0 


TABLE 25.5 ANALYSIS OF VARIANCE 


Sum of Mean Expectation of 


Due to df Squares Square Mean Squares 
Replicates 2 16.10 
Blocks component a D. Ub. 
Blocks component b 9 29.74 3.30 e? + ($365, 
"Treatments 11 15.63 
Error 13 12.57 0.97 o 
Total 35 74.04 


The weights are estimated as 


w= E = 1.03 
and i 
2 
a were y) 
3 x 3.30 — 0.97 
The quantities x and p are estimated by 
— 81 
i i u 95010 
5 X 1.03 4 * 0.22 4.27 
0.81 
" = 0.018 


AÁ 
8 X 1.03 + 0.22 
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The adjustments are, therefore, 


i j k 
1 —0.27 0.16 2.61 
2  —0.80 0.00  —0.21 
3 0.73  —1.53 1.20 
4 —2.18 —2.52 2.82 


The variances (approximate) of treatment comparisons are 


1 (1 14 X 1.03 + 4 * — 
3 X 1.03 A 


for treatments occurring together in a block, and 


1 ( 21 X rem) 
3 X 1.03 4 


for treatments not occurring together in a block, where A = 4.27 X 
8.44/0.81 — 44.49, and are, therefore, 0.43 and 0.49, respectively. For 
most purposes, it will be sufficiently accurate to use a mean variance of 
0.46. 

If a complete randomized block design had been used, the error mean 
square would have been 1.92, with a mean variance of treatment com- 
parisons of 0.64, so that the efficiency of the triple rectangular lattice 
in this (hypothetical) case is estimated to be 139 percent. 


25.6 FURTHER NOTES 


"There is little need for further rectangular lattice designs, though 
for some values of k, quadruple lattices and so on may be written out. 
The analysis of these would be similar to the analysis given above, the 
derivation proceeding on exactly the same lines. The computation of 
variances of estimated differences would be rather tedious. 

The case of k(k — 2) treatments has not been discussed because it 
is considered unlikely to be important. The case of k(k — 3) treat- 
ments is also not likely to be important because k(k — 3) = (k — 1) 
X (k — 2) — 2, and the experimenter with this situation would usu- 
ally be able to drop 2 treatments and use the designs described above. 

We have not discussed the missing value problem, and it does not 
appear that a study has been made. An approximate procedure which 
may be suggested is to derive the intrablock estimates for the missing 
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values and then to use these as though they were actually observed 
with a modification in the error degrees of freedom. 
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CHAPTER 26 


Balanced Incomplete Block Designs 


26.1 INTRODUCTION 


The previous three chapters have been concerned with the problem 
of arranging a number of treatments in blocks the size of which is less 
than the number of treatments, in such a way that an analysis is sim- 
ple and gives estimates of treatment differences with variances as low 
and as equal as possible. In those chapters we made use of a corre- 
spondence of the treatments to the treatment combinations of a num- 
ber of factors. Such a correspondence is of value only in certain cases: 
for example, if we wish to compare 8 treatments in blocks of 3 experi- 
mental units, à representation of the 8 treatments as treatment combi- 
nations resulting from 3 two-level factors appears to be of no help. 

The designs discussed in the previous chapters are primarily suited 
for field plot trials, or industrial experiments, when the number of ex- 
perimental units and their grouping into blocks is completely under 
the control of the experimenter. This is particularly the case for de- 
signs with 2 restrictions. They are also available only for specified 
numbers of treatments and mainly for large numbers of treatments, 
say, 25 or more. There is then need for designs in which rather smaller 
numbers of treatments may be compared in small blocks. In biological 
work on animals, for example, it will be desirable, if at all possible, to 
compare several treatments within litters, but the size of litter will de- 
pend on the particular species and will often be such that it is impos- 
sible to include all treatments within a litter. There are 2 classes of 
design for this situation: namely, balanced incomplete block designs 
which are the subject of the present chapter, and partially balanced in- 
complete block designs, which will be described in Chapter 27. It 
should be noted that there is no essential difference between the lattice 
designs and those to be described here. The separation was made be- 
cause the lattice designs arise naturally from a factorial correspondence, 
and their analysis is facilitated by this correspondence. 
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As an example of the type of design we shall discuss in this chapter, 
consider the following arrangement for 6 treatments, a, b, c, d, e, f, in 
blocks of 3 experimental units: 


a,b,c; a, b, d; a, o, e; a, d. J; a,ef 
b. c, J; b, d, e; b, e, : e, d, e; c, d. f 


Note that each treatment is represented 5 times and that every pair of 
treatments occurs together in a block twice. The groups of treatments 
making up a block are assigned to the groups of experimental units at 
random, and treatments are assigned within the groups at random. 
Designs with the above properties, that each treatment occurs equally 
frequently, and that each pair of treatments occurs together in a block 
equally frequently, were called by Yates! who first proposed them, 
symmetrical incomplete randomized block arrangements or, more 
briefly, balanced incomplete block arrangements. 

There are two main problems with such arrangements: the design 
and the analysis. The designs cannot, in general, be obtained by any 
formal procedure, though they may occur in related groups. The 
method of analysis is related to the methods by which lattice designs 
are analyzed, although there is no factorial analogy. The practical 
value of the design will be evident from the discussion of its analysis. 


26.2 EXAMPLES OF INCOMPLETE BLOCK DESIGNS 


As a first step in the problem of enumeration of designs, we will con- 
sider patterns, which have arisen in earlier chapters and in different 
connections, that may be adapted to give balanced incomplete block 
designs. 

Consider then the 2” factorial system, and, to be even more particu- 
lar, the 2° system with factors a, b, and c, say. For this system we 
found that there were 7 distinct systems of confounding into blocks of 
2 plots, those given in Table 26.1 where the crosses in a line indicate the 
effects and interactions confounded. 

Now, if we regard the symbols A, B, AB, C, AC, BC, ABC as treat- 
ments 1, 2, 3, 4, 5, 6, 7 and the rows of the above table as blocks we 
have 7 blocks which may be written as (123), (145), (167), (246), (257), 
(347), (356). 

It is obvious from the table that we have arranged the 7 treatments 
in blocks of 3 plots in such a way that each treatment is represented 3 
times and euch pair of treatments occurs together in a block once. The 
block arrangement is then a balanced incomplete block arrangement. 
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TABLE 26.1 
Effect or Interaction 


A balanced incomplete block arrangement for 7 treatments in blocks 
of 4 plots is obtained by assigning the treatments corresponding to un- 
confounded effects and interactions to blocks. In this case each treat- 


ment occurs 4 times, and each pair of treatments occur together in a 
block twice. 


In this way we may obtain arrangements for 2" — 1 treatments in 
blocks of 2" — 1 or of 2" — 2" plots. The total number of blocks neces- 


sary is equal to the number of systems of confounding of the 2" system 
in blocks of 2"~*: i.e., 


(2" — 1)(2" — 2) „ (2^ — 2*7!) 
(2° — 1)(2" — 2) e- 277) 
The number of times each treatment is replicated with blocks of 2" — 1 is 
2-1 
(5) Koo 
and the number of times each pair of treatments occurs together in a 


block is E (=) K(n, s) 


K(n, 8) = 
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If we adopt Yates's notation, namely: 


Number of treatments: “ 

Number of experimental units per block: k 

Number of replications of each treatment: r 

Number of blocks: b 

Number of times any 2 treatments occur to- 
gether in a block: à 


then the above procedure leads to the designs of possible practical in- 
terest shown in Table 26.2. 


TanLE 26.2 
ts ers UON 
8 
1 

4 4 2 oh 
15 ee 
1569) “te 159 
1 87.015 4 
31 3 15 15 1 
31 7 35 155 7 


In the same way we may utilize the examination that was made of 
systems of confounding for p" treatment combinations in blocks of 
pu- ( < n) to give incomplete block designs for (p" — 1)/(p — 1) 
treatments in blocks of (p* — 1)/(p — 1). For example, we found that 
there were 13 systéms of confounding for the 3° system with factors 
a, b, and c in blocks of 3 plots, namely: 


1. 4, B, Abe ABI 8. AB, C, ABC, ABC? 
2. A.C, ACS A01 9. AB, AC, BC, ABC? 
3. A, BC, ABC, AB?C? 10. AB, AC?, BC, ABC 
4. A, BC?, ABC?, AB*C 11. AB?,C, ABC, ABC? 
8. B, C, BOR "BC: 12. AB?, AC, BC, ABC? 
6. B, AC, ABC, AB'C 13. AB?, AC?, BC, ABC 
7. B, AC?, 4820, ABC? 


If we regard the symbols A, B, AB, AB?, etc., as 13 treatments, the 
above gives an arrangement for the 13 treatments in blocks of 4 plots, 
such that each treatment is represented 4 times and every 2 treatments 
occur together in a block once. 
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In general, this procedure leads us to designs for (p^ — 1)/(p — 1) 
treatments in blocks of (p' — 1)/(p — 1). The number of blocks is 
equal to the number of systems of confounding for p" treatments in 
blocks of p"^* plots, i.e., equal to 

(p? —D(n' =p) ot» 

(pto (pp) = (gt pt) 
'The number of times each treatment is represented is equal to the num- 
ber of systems of confounding involving a specified effect or interaction, 
i.e., equal to 

DF . . ) 

CUED p i = p) 
The number of times any pair of treatments occur together in a block 
is equal to the number of systems of confounding that involve a speci- 
fied pair of effects or interactions, i.e., equal to 

Q^ — »)» — p°) . . (p" — p~) 

(p* — p)" — p) «++ (pt — p!) 
The following designs are of some possible practical interest: 


han 5 X 
40 4 13 130 1 
21 5 21 5 1 
45% ( A I 
BUN 68. 57.1 


26.3 THE GENERAL CASE 


j With the symbols t, k, r, b, and ^ defined as in the previous section, 
the following relationships hold: 
bk = tr = total number of plots, A= sm 2 
t — 
The second relationship holds because every treatment occurs equally 
frequently with a specified one within a block, so that r(k — 1) equals 
A(t — J). 
The simplest case is that of symmetrical pairs, i.e., with k = 2, for 
then all possible pairs of the ¢ treatments are represented, and 


i(t — 1) 


b 


* 1211, X 21 
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In the same way, to obtain a design in blocks of k units, we may take 
all the combinations of the treatments k at a time, and this gives 
t! (t — 1)! (t — 2)! 


b oS ws ENR eS toe See 
vlt — k)! (k — 1) t — k)! (k — 2)\(t — k)! 


In general, however, this procedure will lead to a very large number of 
replicates, and it is desirable to find designs involving a lower number 
of replicates. Since à = r(k — 1)/(L— 1) must be an integer, it is pos- 
sible to place a lower limit on the number of replicates necessary for t 
treatments in blocks of k units. For example, if £ = 12 and k = 5, we 


have that 
hearty 


b-5 = 12r 


and also 


so that r must be divisible by 5 and by 11 and, therefore, must be a 
multiple of 55. Whether a design exists for just 55 replicates must, 
however, be determined by enumeration methods. 

An extensive list of designs is given by Fisher and Yates? and by 
Cochran and Cox. Several are obtainable from completely orthogo- 
nalized squares or prime power factorial systems. Others obtained by 
enumeration are of cyclic nature: for example, the design for 11 treat- 
ments in 11 blocks of 5 units (r = 5, \ = 2) may be obtained by num- 
bering the treatments 1, 2, 3, , 11, taking the first block as (1, 2, 3, 
5, 8) and generating the other blocks by adding successively 1, 2, 3, 
to 10, reducing the sums modulo 11. For instance, the 5th block, ob- 
tained by adding 4, consists of treatments 5, 6, 7, 9, 1. Methods of 
enumeration are discussed by Bose,‘ Bhattacharya,’ Hussain and 
Rao.” 

In the previous section, we described some methods of enumeration 
of designs. We noted in Chapter 16 the representation of the effects 
and interactions in a p” factorial system as a finite projective geometry 
and the fact that a system of confounding was given by an m flat in 
that geometry. The examples in section 26.2 are obtainable then by a 
representation of the ¢ treatments as the elements of a finite projective 
geometry. Of the existing designs for a number of treatments less than 
20, say, the remainder were obtained by various methods. The sim- 
plest conceptually is to determine the smallest number of replicates 
that is possible, because A is an integer, and then to enumerate the de- 
sign by trial and error in a systematic way. It is, for example, a simple 
matter to obtain the design for 6 treatments in 10 blocks of 3 in this 


way. 
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After the pioneer work of Yates, the subject of the enumeration of 
balanced incomplete block designs has been dealt with extensively by 
Bose and other members of the Indian school with some work also by 
Fisher.“ The account given by Bose“ is systematic and fairly exhaus- 
tive, and the reader may refer to this paper. The two principal meth- 
ods Bose describes are the use of finite geometries and the use of sym- 
metrically repeated differences. 


26.4 THE ANALYSIS OF BALANCED INCOMPLETE BLOCK 
EXPERIMENTS 


As in the case of quasifactorial designs there are two types of infor- 
mation on treatment comparisons provided by the experiment: intra- 
block derived from comparisons within blocks, and interblock from com- 
parisons between blocks. 

The model used for the intrablock comparisons is the usual additive 
one, 

yg = etd + rude; (1) 
where 
yij = the yield in the ith block of the jth treatment 
(if it occurs in that block, of course) 


b; = the effect of the ith block 
lj = the effect of the jth treatment 


and the ¢;;’s are uncorrelated and have a mean of zero and constant 
variance . Again the assumptions about the €ij'8 follow from the as- 
sumption of additivity, apart from the condition of constant variance. 
The situation we have is a simple case of the 2-way classification with 
unequal numbers and without interaction, discussed in Chapter 6. 
The equations for estimating treatment differences are 


2 
ni nini 
N4— x3). — ( 1 70) „ EET o 2 
(v; Ly" LEE. y = Qi, 121, % (2) 
where n; is the number of times the treatment j occurs in block i, 
n 
N. = Ling, and Qj = Y;— Lx Y;.. For the case we are con- 
7 Ni. 


sidering, the design specifies that n;; is either zero or unity, V. is equal 
to r for all 's, and N;. is equal to k for all i's. Furthermore, the quantity 
nana is equal to à, for every pair (jj), because any specified treat- 
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ment occurs with another specified treatment in a block x times. The 
equations 2, therefore, reduce to the following: : 


r A 
— 147 —— fj = Q; j21,2,::5t 
( Ja 1 y = Q; J (3) 


j'-j 
f X A 2 
= = Si 77 = 1, 2, % 4 
(r vri) pen % „ „„ 0) 


Differences of the 7;’s are, therefore, estimated by the differences of 


2 2 


5 
T + ^ rE (6) 
T — — — 
xk * 
where 
(* — 1) . r(k — 1) 
= since A = 
k(t — 1) t-1 
Furthermore, 
N 
j 4 8 
where 4 
V; = the total yield under treatment j 
and 


T; = the total of blocks containing treatment j 


If k is greater than Vt, it is simpler computationally to use the dif- 
+ 


ferences x = zt (v, + 2 where T"; is the total of blocks not 
D 


rE 
containing treatment j, because T; + 7"; is equal to the grand total, 
for any j. It follows also, from the theory of Chapter 6, that the true 
variance of the estimated difference of 2 treatments is 20% E, and that 
any comparison of the treatments, say, Zajrj, with Zo; — 0, is esti- 
mated by 


Q; (6) 
I rE 
with a variance of 2 
(Ze E (7) 


It is for this reason that the quantity (k — I) / — 1), which also 
equals /A/rk, was denoted by E, because it measures the efficiency fac- 
tor of the incomplete block design, that is, the variance of a treatment 
difference for a randomized block with the same number of replicates 
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divided by the variance for the incomplete block design, assuming c? 
to be the same in both cases. 

'The information on treatment comparisons given by the block totals 
may be extracted by noting that, under the assumptions made above, 
& block total B; is given by 


B. = ku +k} tj + kbi (8) 
(i) 
where D^ t; is the sum of the treatment effects for the treatments occur- 
@ 

ring in block 7, and the b;'s are uncorrelated, with a mean of zero and 
constant variance. The assumption about the b;'s is validated by the 
assumption of additivity plus the random allocation of groups of treat- 
ments to blocks. Equation 8 is written occasionally as 


Bi kath Bits + bbe + Den (8a) 
(i) 


where the b;s are normally and independently distributed around a 
mean of zero with constant variance o°, and the e;;'s are normally and 
independently distributed with a mean of zero and variance o”, in con- 
formity with an infinite model. Which form is followed is somewhat a 
matter of taste, though we prefer the form given in equation 8, for the 
reasons stated in Chapter 8. It is readily verified that the estimates 
of treatment differences based on the B;'s are given by the differences of 


T; 3 
or 
1 N T—AÀ 


(9) 


and that the variance of the estimated difference of any 2 treatments is 


2 k 2 
RENI (o^ + ko*») 
" A I 
where (c? + kc?) is equal to s; Xb’; for equation 8 or the obvious quantity 


for equation 8a. 17 we know 


l 1 
W=- and W m o 
0 o? + ko, 
we may combine the two estimates of treatment differences weighting 
inversely as their variances, to give the best linear unbiased estimate. 
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These estimates of treatment differences are given by the differences of 


the quantities 
j T, — N 
, (=) y' 
rE T—À k 


yy (10) 
r=) 
rEW + —— N 
k 
Substituting for Q; in terms of V; and T, we find 
y; (W =W’) ; 
-Lq 115 ee RR DT 
Vi z + ma- piwe- W“ )V;-( )T;] 
or 
V; 
y; - + - BY; - - DT (11) 
where 


= . 
7 1) = k) 
Multiplying y; by 7, and adding »(k — 1)G, where G is the grand total, 
we get the form given by Yates," 


Y; = Vit »W; (12) 
where 


W; = (t — k)V; — (t — 1)T; + (k — 1)G (13) 


Treatment differences as totals of r replicates are given then by differ- 
ences of the Vys. The total of the W;'s is zero and of the Y;’s is G. 
The variance of a difference of any two Y;'s is equal to 


1 


215i — 
1 AN 
rEW 4- ri W' 
which equals 
2rk(t — 1) 
MEER ee 
Wilk — 1) + W(t — k) 
Each Y; may be regarded as having à variance of 


rk(t — 1) (14) 
Wk — 1) + W'(t — k) 


for any comparison of the 8. 
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26.41 The Estimation of the Weights 
Following the usual procedure we estimate the weights W and W" 
by the analysis of variance which will have the form: 


df 
Blocks eliminating treatments b-1 
Treatments ignoring blocks t—1 
Error rt —t—b-1 
Total rt — 1 


The difficulty here is that the sum of squares for blocks eliminating 
treatments contains 2 components. The computational procedure de- 
scribed by Yates? is useful not only in obtaining the analysis of vari- 
ance but also in indicating the composition of the sum of squares for 
blocks eliminating treatments. The notation is as follows: 


dev? T: sum of squares about the mean of the quantities 7', etc. 
block totals 

obtained by addition or subtraction 

requires checking 

same in both analyses 


lisa 


TABLE 26.3 STRUCTURE OF ANALYSES OF VARIANCE FOR BALANCED INCOMPLETE 
Brock Desian 


> Sum of 
Method a df Squares Sum of Squares Method b 
Blocks (ignoring treatments) Blocks (eliminating treatments) 
dev! T dev? W 
Treatment ponent t-1 ERE IURIS 
vies 7 Treatment com ponent 
Remainder b-t t et Remainder 
dey? B* 
Total b-1 E E 1 Total 
Treatments (elimjnating dev? ki dey? T 
blocks) 1-1 E Ask Treatments (ignoring blocks) 
Intrablock error n-t-b+1 t tt Intrablock error 
Total n-1 dev! y* ++ dev! y* Total 


This analysis is self-explanatory and follows from general considera- 
tions. For example, dev? kQ/k*rE is of the form DU,, of Chapter 6, 
as is also dev? T/k(r — A). The divisors may be checked with a little 
algebra. It is self-checking apart from the items with an asterisk as 
may also be proved algebraically. 
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The expectations of the mean squares for blocks eliminating treat- 
ments are as follows: 


Treatment component t-1 o? + Eko’, 
Remainder b-t e? + kao’, 
bk —t 
— 2 [EA 
"Total b-1 of + G E ) oy 


The expectation of the remainder mean square is as stated, because 
the sum of squares represents the sum of squares between block totals 
eliminating treatments with the appropriate divisor, and the variance 
of a block total on a per plot basis is (s? + ko?,). The expectation of 
the treatment component may be obtained by subtraction. ‘ 

Denoting the intrablock error mean square by E and the over-all 
mean square for blocks eliminating treatments by B, we may estimate 
W and W’ by 


1 V u(r — 1) 
w= 
E 


V7 XO — DB - (t — BE 


‘and 


If it is found that B is less than E, it may be assumed that c is zero for 
the purposes of weighting, and, in that case, w = w’, and the equations 
for estimating differences reduced to Y, = Vs. 


26.4.2 Special Cases 

There are two special cases. 

(a) Growps of Blocks Arranged in Replications. In some cases it is 
possible to arrange the blocks in groups such that each group consists 
of one or more replicates of the treatments. Balanced lattices; for ex- 
ample, are of this type. If so, it is desirable to utilize this property in 
the design since the block variability as measured by 0% will be less 
than if blocks were arranged completely at random. If there are c such 
groups, the block components of the analysis of variance may be further 


subdivided as shown in Table 26.4. 


TABLE 26.4 
df Expectation of Mean Square 
Groups of blocks c-l 
Varietal component £—1 o? + Eko*, 
Remainder b ter P Fko 
Varietal component b 
and remainder b-c a+ ANS. oy 


The estimate of W’ will, of course, be similarly modified. 
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In the special case when c — r, that is, when the blocks can be arranged 
in single replications, the expectation of the mean square for the (b — r) 


(r—-1) 
r 


koa, and the estimate of W’ is 


degrees of freedom is c? + 


TB — E 
which are also arranged in complete replicates, and it holds for any in- 
complete block design with constant size of block. 

Balanced incomplete block designs which may be arranged in sets 
of blocks, each set containing a complete replicate, are known as re- 
solvable balanced incomplete block designs. Bose" obtained the re- 
sult that, if a balanced incomplete block design with parameters f, b, 
T, k, X is resolvable, the following inequality must hold: 


w = This is the formula that we obtained for lattice desig:s, 


b2titr—1 
For, suppose the blocks of the ith set are 


By, Ba, +++, Bis, 170,1 2,:,;7—1 
then, 
t = nk, b = nr 


Take a particular block, say Bol, and let l;; be the number of treatments 
common to the blocks Bo; and Bi, for i = 1, 2, ., r 1, = 1, 2, 
***, n. Let m denote the mean value and s? the variance of the n(r — 1) 
quantities jj. Then, it may be shown that 


and 
g.Ids-m* t D . 
un, =I) 150 100 — 1) 


The result follows since s? is non- negative. 
If for a resolvable balanced incomplete block design the equality 


b=t+r-1 


holds, the design is termed by Bose an affine resolvable balanced in- 
complete block design. Two blocks belonging to different sets have the 
same number of treatments in common, for s? equals zero, and, con- 
versely, a design with this property is affine resolvable. 
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Consider the 4 designs: 


[NE „ et 
610 532 
1018 9 5 4 
28 36 9 7 2 
14 26 13 7 6 
The condition 
b=t+r-1 


holds for all these designs, but they are not resolvable because the num- 
ber of treatments common to any 2 blocks from different sets would be 
k?/t always, and in no case is this an integer. 

The design with parameters 


128, b=14, r=7, k=4, 1-8 


is resolvable and necessarily affine resolvable. This design is, of course, 
the quasifactorial design corresponding to arrangements for a 2? sys- 
tem in blocks of 2? and is obviously resolvable from this method of 
construction. 

(b) Number of Blocks (b) = Number of Treatments (t). In this case 
the analysis reduces to that shown in Table 26.5. 


TABLE 26.5 
df Sum of Squares 
"Een 11 dev? W 
Blocks eliminating treatments - 7 7.5 
led 1 evt 
"Treatments ignoring varieties t-1 7 dev y 
Intrablock error (k—2)t+1 By subtraction 
Total *. — 1 dev! y 


26.5 YOUDEN SQUARES 


In the case of balanced incomplete block designs for which ¢ = b, 
i.e., the number of treatments equals the number of blocks, it is possible 
to arrange the ¢ blocks and treatments within the block in such a way 
that they form an incomplete Latin square. For example, with ¢ = 7, 


+ * 
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k = 4, b = 7, r = 4, the 7 treatments, say, 1, 2, 3, 4, ---, 7, may be 
arranged thus: 7 


22 — 
— c 9 tw 
Va me 
on o 
— Oa 
annso 


1 
3 
6 


If it is possible to arrange the experimental units according to a 4 X k 
classification, the rows and columns of which account for an appreciable 
portion of the variation of the experimental units, such an arrangement 
of treatments will be advantageous. 

It was proved by Smith and Hartley u that, for all incomplete block 
designs in which the number of treatments is equal to the number of 
blocks, such an arrangement exists. "These designs are known as You- 
den squares after Youden * who first discovered them. The analysis 
follows directly from the analysis of balanced incomplete block designs 
already discussed. The model that is assumed in the analysis is 

Vük = u + ri + b; + te + eig. (15) 
i, J, k being the row, column, and treatment numbers, and the eijk’ 8 
being ‘uncorrelated and distributed around zero with variance c?. If 
the intereolumn information is utilized, it is also assumed that the b,’s 
are uncorrelated and distributed around a mean of zero with constant 
variance. 

The solution has already been obtained, because treatments are or- 
thogonal to rows, namely, that the yield under treatment j is estimated 
to be Vo» 
har Mio 1)7; + (k — 1)G] (16) 


where V; is the total under treatment k, T; is the total of the blocks 
containing treatment 7, and G is the grand total. 
The analysis of variance is given in Table 26.6. 


TABLE 26.6 ANALYSIS OF VARIANCE FOR YOUDEN Squares 
Mean Expectation of 


Due to df Square Mean Square 
Rows k=-1 
p. tk — t 
. Columns eliminating treatments t-1 B e G = 10 oy 
Treatments ] t-1 
Error (k — 2)(t — 1) E a 


— 


Total 41 — 1 
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The estimation of W and W’ is the same as for balanced incomplete 


block designs. 


The Youden square design is a special case of an incomplete Latin 


square. We noted in Chapter 10 that a Latin square with one row re- 
moved constituted a valid experimental design. A Youden square is a 
Latin square with several rows removed, the remainder having the 
property that the columns form a set of balanced incomplete block de- 
signs. Cochran and Cox? give some interesting designs which consist, 
of a Youden square adjoined to a complete Latin square. These de- 
signs are useful for a small number of treatments. 


— 


. YoupEN, W. J. Experimental designs to increase accuracy of 
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CHAP T ER 27 


Partially Balanced 
Incomplete Block Designs 


27.1 INTRODUCTION 


We have seen in the previous chapter that completely balanced in- 
complete block designs exist for certain numbers of treatments only 
with an inordinately large number of replicates. For example, with 8 
treatments and blocks of 3 units, the lower limit to the number of rep- 
licates is 21, and with this number of replicates the blocks would con- 
sist of all combinations 3 at a time of the treatments. As a result Bose 
and Nair ' were led to the consideration of partially balanced incomplete 
block designs. The present chapter will be based largely on the work 
of Bose and Nair! and of Rao.? 

As a first step in the consideration of the problem, let us suppose that 
we have / treatments and wish to test them in b blocks of k units in 
such a way that each treatment is represented r times altogether. The 
blocks will be numbered from 1 to b, and we shall use the symbol 4;; 
which equals unity if treatment j is in block 7, and equals zero other- 
wise. The design is specified essentially by the numbers 5% with 1 = 1, 
2, ---, band j = 1,2, ---, f, and we shall attempt to choose these num- 
bers in such a way that the design has optimum properties. We con- 
sider, therefore, the estimation of treatment differences with an experi- 
ment arranged according to the set of numbers 4,;. For the intrablock 
estimates we shall use the additive model 


yj = u + bit rj + eij (1) 
where 


yij = the yield of treatment j in block? 
u = the common contribution 


b; = the contribution of block i 
542 
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7j = the contribution of treatment j 


eij = an error with mean zero, which we may regard as un- 


correlated with all other e;s and as having a vari- 
ance of c? 


For the interblock estimates, we use the model 


V.. = ku + È dus + kb. (2) 
in which à 
Y;. = the total of the block 
and 


b; = an error with mean zero, uncorrelated with other bis and having a 
1 
variance of 5 (e? + ke?) 


In addition, the bs may be regarded as being uncorrelated with the 
eij'8. 
The intrablock estimates are obtained by minimizing 


x (yj — — bi — 75)? (3) 


and, since this is the ordinary 2-way classification problem, the esti- 
mates of the 25s are given in the notation of Chapter 6 by the equations, 


G NSC) 


1 


Q;., j=1,2, 5t (4) 


where 
Query — Mt 
Applying these equations to the present problem, we have 

nij = bij 

N.. =k, forall?'s 

N.; =7, for all 's 


so that the equations become 


Erde z^) EE 


-Vj-— (5) 
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where V; is the total yield under treatment j and T; is the total yield 
of the blocks containing treatment j. 
The interblock estimates are obtained by minimizing 


2; (F.. = ku — PP 575)? (6) 
i 7 
80 that we have the equations 
bk?a +k » > 94$; = kY.. (7) 
and Tod - 
dn + E bite) = D Ys j=1,2, %%% (8) 
1 j' i 


The equations 7 and 8 reduce to the following: 


t 
ben + kr 0,8; = kY.. (9) 


rkp + er 1505.) fp Ledi Ve. JI, 2, %% (10) 
SENSE 7 7 


t 
We shall measure the 7's around a mean of zero, so that >> ^ = 0, 
i 


and the equations for the ?'s are then 


FY. 
2» (= ay) 77. = x ö Yi. — tp À (11) 
We now note that 
D sib; =r 
and that ^ 
25 6. Fe. - T; 
so that equation 11 may be written l 
: YES 
1 ＋ (= ihv) e E S (12) 
j'-j i b 


and in this form the equations are ntrikingy similar to equation 5 for 
the intrablock estimates. 

If we know W = 1/c?, and W' = 170 + bz), we can obtain the 
combined estimates of the zs by minimizing the weighted sum of 
squares of deviations, that is, 
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W' 
WX; = b. . LG. Nn, (13) 
D i j 


so that, if we combine equations 5 and 12 with the appropriate weights, 
the combined estimates are given by the equations 


k—1 W' W-W' 
[reete ts E) 


wa  (n-A) d 
mW AS er (14) 


Now, the quantity >> 5;j5;;; is equal to the number of times that treat- 


LI 
ments j and j’ occur together in a block, and, if we denote this by Ni., 
the equations have the simple form 


r L ( + | 8- (= — T) P» 


k k PER roe 


W' TE 
= WQ;+ zn = — (15) 


We may note in passing that these equations are particularly easy to 
solve in the case when Aj; is a constant, equal to A, say, for then they 


may be written as 


re becher F- 


since L 4; = 0, and these equations give the estimates for differences of 


the z/s which we obtained in Chapter 26 for balanced incomplete 
blocks. - 
Given any arrangement of t treatments 1 


that each treatment is represented r times, ise 
to obtain estimates of the 7;’s, or, by virtue of the condition we impose, 


of the (r; — r.)’s.. We now have to consider specifications of the TAE 
and, therefore, of experimental designs. The case of dj, equal to N 
for all 's and j"s has been discussed in Chapter 26, and we found that, 
for many combinations of the 2 numbers ¢ and k, the number r neces- 
sary in order that Ajj; be constant was too big for practical purposes. 


n b blocks of k units such 
we may use equations 15 


‘ 


546 PARTIALLY BALANCED INCOMPLETE BLOCK DESIGNS 


The next step is clearly to suppose that, given a treatment j, the 
numbers Aj; are equal within groups of the other treatments. The 
Mies are integers, less than or equal to r and we suppose that, over all 
J's and qs, they take one of the values Ni, Xo, „ As where M > A» > 
Ag +++ >As The set of treatments , for which Aj» = Ni, will be de- 
noted by S(j, 1) and called the first associates of treatment j. The set 
of treatments J’, for which Ajj = As, will be denoted by S(j, 2) and called 
the second associates, and so on. With reference to any one treatment, 
say, j, the other treatments fall into s sets S(j, 1), S(j, 2), «++, S(j, s), 
which are its first associates, its second associates, .., its sth associ- 
ates, respectively. Now we consider the equations 15 in this light, 


and, if we denote r (A) | by a, "e by 8, and 


W' y 
|o, 18 * Q — Za) by P, these equations may be written: 


af, — BMG — GN = NG = Pi 


afa — BMGo1 — BroGog = BN Go, = Pe 
(16) 


af, — BNC — BN +++ — N, G, = P, 


where G;; = the sum of the #’s for treatments in S(i, j), and so on. The 
problem of design is reduced then to a choice of the sets S(j, a), the ath 
associates of treatment j for each j, and we shall choose these sets in 
such a way that the equations 16 may be solved easily. The form of the 
equations 16 indicates that we can reduce the equations to be solved to 
a set of (s + 1) equations in #;, C, Gjo, «++, Ge, if certain conditions 
are satisfied. For, suppose we take the equation for fi, the sum of the 
equations for the group of treatments S(1, 1) which are first associates 
of treatment 1, the sum of the equations for the group of treatments 
S(1, 2) which are second associates of treatment 1, and so on, to the 
sum of the equations for the group of treatments which are sth associates 
of treatment 1. If the sets S(j, a) are suitably chosen, this process will 
lead us to a set of (s + 1) equations in the (s + 1) unknowns ĉi, Gin, 
Cis, +++, Gis. We would like, furthermore, for this set of (s + I) equa- 
tions to have the same coefficients for all treatments, so that we can 
write down a general solution. 

If we take any treatment, say, 0, and denote its first associates by 
0'i, 6's, «++, 01, its second associates by 621, G, . &^,, and so on, 


INTRODUCTION 547 


its sth associates being denoted by 6*,, 0*5, „ 6°,,, we must have the 
following set relations: 


For the 6',’s: 
(95, 1) + S6, 1) T. S@ ny 1) 
= k0 + k's, 1) + bels, 2) .. K'uS(, s) 
Sc, 2) + S092, 2) . - + SOn 2) 
= bib + „12800, 1) + K^158(8, 2) +--+ k'i2S(0, s5) (17a) 
S(0'1, 8) + S's, s) K. SO ny 8) 
= ky + S0, I) + K*,8(6 2) +--+ 10, 8) 
For the 67;’s: 
S@1, 1) + 80022, 1) +++: + Say 1) 
= kg + k'348(0, 1) + K23,8(6, 2) +--+ 2180, 8) 
S(£^, 2) + S62, 2) K. S@ng 2) 
= ko + k'228(0, 1) + K*558(8, 2) - + k'a9S(0, 8) (17b) 
S(85,, s) + S(055, 8) +++ + SPs 9) 
= kað + 12, S(0, 1) + 122.800, 2) P. 2.800, 8) 


and so on. These relations must hold for any choice of 0, so that kii 
must be constant for all 6’s. Since each term of the sum S(0, 1) + 
S(6's, 1) +++ S(0!,,, 1) contains 6 once, ky, is equal to n, and there- 
fore ny, the number of Ist associates, is constant for all treatments. 
Similarly no, na, „ na, the number of 2d, 3d, - , sth associates, of a 
treatment is constant. Furthermore, kij is equal to zero for t unequal 
to j. 
'The equation 17 may be written as the single equation: 


Sz, D) + 8002, D T. Sd D 
= uni + Ks, 1) + * S (0, 2) T.. s, 8) (18) 


This states that any rth associate of 6 occurs in k";; of the sets S(9^, l), 
S'a, D, +++, (05, ). We shall now prove that each of the sets So, 0), 
j=1,2, =n contains the same number of members of any particu- 
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lar S(0, r). Let S(% l) contain a; of the elements of S(0, r). Then a; 
of the elements 07% y = 1, 2, - „ n,, are lth associates of 0. Now, con- 
sider the sum of sets t 


SO", D) + S00˙, ) +--+ S0 0) 
which is equal, by equation 18, to 
b, m,8 + k',pS(0, 1) + K*48(0, 2) ++ +++ Ko, i) +++ + k'uS(0, 8) 

This states that of the 6's have any particular member of the set 
S(@, i) as an lth associate; therefore, a; = . Thus, we have the con- 
dition that, if any 2 treatments, 6 and $, are ith associates, the number 
of treatments common to the rth associates of 0 and the lth associates 
of $ is equal to *. 

In this way we can say that the design is specified by 4, k, ni, ns, 


101, Mey NI, Avy +++, N, and the k',,’s. We now proceed to determine the 
relationships that exist among these quantities. 
Clearly, 


m ＋ na Tn. =t—-1 
nj + Rada T n, = r(k — 1) 
where r is the number of replicates, and, by symmetry, 
Fri = ki, (20) 


Also from the set equations 18 and 20 and the result about ^, the 
relationship 


(19) 


ni = n'a (21) 
holds. 
By summing all the s equations involving the sets S(0';, 1), 80% 2), 
we find that the sum of the left-hand sides is 


nið + (ny — 1)S(0, 1) + n,S(0, 2) +--+ nS(8, 8) 
while the sum of the right-hand sides is 
m0 + (= Hy) S(0 1) + (= Wy) S(0 2) ++ +++ (z 2 S(6, 8) 
j j j 
so that 
x ky =; = 1 
j 
D kij =n, 1 1 
j 
Similarly, we may prove all the relations, 
L kyen- if i=l 
E =n if ixl (22) 


\ 
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27.2 THE SPECIFICATIONS OF PARTIALLY BALANCED 
INCOMPLETE BLOCK DESIGNS - 


We have, in section 27.1, obtained the specifications of partially bal- 
anced incomplete block designs as given by Bose and Nair. We shall 
now adopt their terminology, as it is used exclusively in the literature. 
Summarizing the results of our discussion in section 27.1, we may state 
that a partially balanced incomplete block design has the properties: 


1. There are f treatments in b blocks of k plots, and r replicates of 
each treatment. 

2. With reference to any specified treatment, the remaining (t — 1) 
fall into m sets, the ith set of which occurs with the specified treatment 
in A; blocks and contains n; treatments, the numbers n; being the same, 
regardless of the treatment specified. 

3. If we call the treatments that lie in a block A; times with a specified 
treatment 6, the ith associates of 6, the number of treatments common 
to the ith associates of @ and the jth associates of ¢, where 0 and ¢ are 
kth associates, is p*;;, this number being the same for any pair of kth 
associates. 


The relationships we found are: 
ni + ne+ngt s+ tm =t—1 
njM + made + nas E. Mdm = r(k — 1) 
p'ü = pit (23) 
np = nip'j = njpla 


Epy = m — ôn 
7 


The parameters r, b, t, M, Xo, ***; Ams Ta, n2, 7s Tim Bre called by Bose 
and Nair ' the parameters of the first kind and the p*;;'s the parameters 
of the second kind, It is shown by Bose and Nair that, by virtue of the 


2 
) independent pa- 


relationships 23, there are, in fact, only m( 


rameters of the second kind. : 
Let us now examine the possibilities of a partially balanced incom- 


plete block design for 9 treatments in blocks of 3, and suppose we allow 
two classes of associate: namely, M = 1, M = 0. Then, the relations 


= ny +n =8 
n = 2r 
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so that n, must be even. We therefore consider the case n) = 6, nz = 2, 
and examine the p*;?s. We have the relations: 


Pit pie =5 
P'a + plos = 2 
puc p12 = 6 


D^» + ps = 1 
and, since : : 
nip. = NjP ik 
we have 
mip'o, = nop, or Op! = 2211 
and 


N1P'22 = mop^iy or 6p'oo = 2p" 19 
Therefore, since each p*;; is a non-negative integer, 
[em =1 and p20 =0 
or 
9221 =0 and p22 1 
If p? n = 1, then plo. = Ig, and thii is impossible. canmi p21 = 0, 


and p^» = 1, and, nee pii = 6, and, hence, p'; = 2, and 
Pu = 3. The matrices p*;; are then 


ate 3 wal’ °) 
INGO e 


We have found, therefore, all the parameters of the design: namely, 
t = 9, k = 3, r = 3, b = 9, nj = 6, M = 1, n; = 2, M = O, and the 
p*;; matrices above. To obtain the actual design, we may assume that 
treatments 2, 3, 4, 5, 6, 7 occur with 1 in a block, and that 8 or 9 does 
not occur in a block with 1. We then make up Table 27.1, in the order 
given, by using the matrices p*;;. 


` TABLE 27.1 l 
Treatment First Associates Second Associates 
1 2, 3, 4, 5, 6, 7 8,9 
8 2, 3, 4, 5, 6, 7 1,9 
9 2, 3, 4, 5, 6, 7 1,8 
2 1, 3, 4, 5, 8, 9 6,7 
6 1, 3, 4, 5, 8, 9 2,7 
7 1, 3, 4, 5, 8, 9 2,6 
3 1, 2, 6, 7, 8,9 4,5 
4 1, 2, 6, 7, 8, 9 3,5 
5 1, 2, 6, 7, 8, 9 3,4 
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The only arbitrary step in the formation of the table is the choice of 
6 and 7 as second associates of 2, for we could have chosen any 2 of 
the 5 treatments 3, 4, 5, 6, and 7. The choice that we make determines 
the design. Given the table of associations, it is a simple matter to 
construct the design, which consists of the 9 blocks: 


(123), (164), (175), (683), (695), (784), (793), (285), (294) (24) 


That the design has the required properties may be verified by the 
reader. Furthermore, we have shown that this is the only design, apart 
from permutations of the treatments, for which the parameters of the 
first kind are as stated. We may note that this design is identical with 
the one we would get by considering the 3? factorial system in blocks 
of 3 and using a set of 3 replicates, or the one we would get from the 
Latin square: 

A (1) BH C 

C6) AG) BO 

B (4) C(8)- 4 (7) 


by confounding rows, columns, and letters, respectively, in 1 of the 3, 
replicates. 

Continuing with the same problem, we could take the case ny = n2 
= 4, and we would find that the matrices p*;; can be 


4 Ne 
PST e Oey Nazi 


After a little enumerative work, it is found that these matrices corre- 
spond to the design in which the 9 treatments are arranged in a square, 
and rows are confounded in one replicate and columns in another, thus: 


giving the blocks 
(123), (456), (789), (147), (258), (369) (25) 


This is again a quasifactorial design: in fact, a simple lattice. In this 
case, with n, = 4, no = 4, r = 2, k = 3, and b = 6, there are other 


p matrices which do not lead to a design. 
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As a second example, consider the case when ¢ = 8 and k = 3, and 
let us see whether there is a design with A; = 1 and Ay = 0. Since ] 
+ nah = r(k — 1), nı = 2r, we may consider the case n; = 6, n = 1, 
and, consequently, r = 3. The p, matrices are readily found to be 


weit n 5 
eee DUANE 0 


We may construct a table of associations, which satisfies these matrices 
(Table 27.2). 


TABLE 27.2 
Treatment First Associates Second Associates 
1 2, 3, 4, 5, 6, 7 8 
8 2, 3, 4, 5, 6, 7 1 
2 1, 3, 4, 5, 6, 8 7 
ká 1, 3, 4, 5, 6, 8 2 
3 1, 2, 5, 6, 7, 8 4 
4 1, 2, 5, 6, 7,8 3 
5 1, 2, 3, 4, 7, 8 6 
6 1, 2, 3, 4, 7, 8 5 


The design is therefore some permutation of 


(124), (176), (135), (825), (873), (846), (236), (745) (26) 


27.3 DESIGNS FOR A SMALL NUMBER OF TREATMENTS 


We shall not discuss in detail the problems of enumerating partially 
balanced incomplete block designs for any number of treatments, any 
size of block, and any number of replicates. Instead we shall consider 
the possibilities when the number of treatments is less than 10 and the 
block size is less than 5. The cases when the number of treatments is 
4 or less are very simple, the possible designs having been discussed 
before. 

With 5 treatments, symmetrical pairs require (5 X 4)/2 = 10 blocks, 
and, therefore, 4 replicates, and there is little need to discuss other de- 
signs in blocks of 2 plots. All combinations 3 at a time would require 
(5 X 4 X 3)/(8 X 2 X 1) = 10 blocks, and therefore 6 replicates, so 
that again we need not discuss the case further, as it is unlikely that an 
experiment with less than 6 replicates could give sufficient accuracy of 
estimates or sufficient sensitivity. The testing of 5 treatments in blocks 
of 4 requires 5 replicates for a balanced incomplete block design, and 
again we do not consider the case worth discussing, though there is the 


I 
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possibility that the experimenter may wish to have a number of repli- 
cates that is not a multiple of 5. 

With 6 treatments, symmetrical pairs require (6 X 5)/2 = 15 blocks, 
and therefore 5 replicates, and this solution is satisfactory for most 
purposes. If the experimenter wishes to use blocks of 3, the design 
given at the beginning of Chapter 26 is a completely balanced incom- 
plete block design with 10 blocks and 5 replicates. With blocks of 4, 
the minimum number of replicates for a balanced incomplete block de- 
sign is 5, since x = r(k — 1)/(t — 1) is an integer, but actually the bal- 
anced incomplete block design includes all possible combinations of the 
treatments 4 at à time and involves 10 replicates. By examining the 
relationships 23, we can deduce the design j 


(1234), (1235), (1236), (1456), (2456), (3456) (27) 
for which 
n = 2, n — 3 
A = 3, he = 2 
r=4 


0 » 3 i a 
PAENG g T NT D 


This design involves 4 replicates and could be repeated if 8 (but not 10) 
replicates are desired. 

For the case of 7 treatments, symmetrical pairs require 6 replicates, 
which is likely to be a reasonable one for most purposes. The balanced 
incomplete block design in blocks of 3 given in Chapter 26, namely, 


(123), (145), (167), (246), (357), (347), (356) (28) 


requires 3 replicates and may be repeated if more replicates. are neces- 
sary. From this design in blocks of 3, we obtain the balanced incomplete 


block design in blocks of 4 plots, namely, 
(4567), (2307), (2345), (1357), (1346), (1256), (1247) (29) 


which requires 4 replicates. Py 1 
With 8 treatments we may use symmetrical pairs if 7 replicates are 
possible. With r, less than 7, replicates, we may regard the 8 treat- 
ments as arising from 3 factors each at 2 levels and may therefore use 
any set of r of the 7 systems of confounding in blocks of 2. If blocks of 
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3 units are desired, the design given in the previous section may be 
used: namely, 

(124), (176), (135), (825), (873), (846), (236), (745) (26) 


To obtain arrangements in blocks of 4 units, we may again utilize a 
correspondence between the 8 treatments and the combinations of a 2* 
system. 

With 9 treatments, symmetrical pairs require 8 replicates. A par- 
tially balanced design requiring 4 replicates is the following: 


(12), (13), (14), (17), (23), (25), (28), (36), (39) 

(45), (46), (47), (56), (58), (69), (78), (79), (89) 
which has parameters: 8 
(99, b = 18, * = 2, r-4, n 24, XI = 1, ng = 4, J = 0 


we 2) 1 65 2) 
P TX Tu dd 


There exist many pseudofactorial or lattice designs in blocks of 3, and 
there is no need to enumerate them here. With blocks of 4, a balanced 
incomplete block design requires 8 replicates, the blocks being 


(1234), (1256), (1278), (1357), (1468), (1369) 
(1489), (1579), (2389), (2459), (2679), (2347) (31) 
(2568), (3589), (4679), (3456), (3678), (4578) 
A partially balanced design which requires 4 replicates is the following: 
(2347), (1358), (1269), (1567), (2468), (3459) 
- (1489), (2579), (3678) 
for which the parameters are: 
t=9, b=9, k=4, r-4 n 9-4, Ji = 2, n = 4, 2 =1 


%% e 


274 THE ANALYSIS OF PARTIALLY BALANCED 
INCOMPLETE BLOCK DESIGNS 


The analysis of partially balanced incomplete block designs is a fairly 
straightforward process, particularly in view of the fact that the designs 
have been chosen so that the analysis is simple. We obtained equations 


(30) 


(32) 
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15 without any restriction on the design, except that the number of 
replicates of each treatment and the block size are to be constant. 
These equations would, in general, be rather difficult to solve, for, at 
most, they can be reduced to a set of (t — 1) equations in (t — 1) un- 
knowns. To obtain the estimate of 7j, we form (s + 1) equations, of 
which the first is the jth equation of the set 16, namely, 
of; — BAG Me — +++ — PN C. = Pj (33a) 
the second is obtained by summing the equations of the set 16 for the 
first associates of treatment j, giving, because of equation 18, with 
pes substituted for k*;;'s, 
aG — BM (mj + p'iiGa + paG +++ pui) 
— BNe(p'iaGji + p'isGjo +++ ++ 12050 (33b) 


— ND, + pe He pee) = API 


where EP; is the sum of the P;’s for the treatments that are first asso- 
ciates of treatment j; the third equation is obtained by summing the 
equations of the set 16 for the second associates of treatment j, giving 


aGj; — Bu(p'aiGg + paG K. + pP'nG;j) 
— Bro(not; + p'asGj + P2220%½ E. + p'22Gjs) — (330) 


na BN (P2551 zb D'osGjo Tee D'24Gjs) = EPa 
where DP, is the sum of the P;’s for the treatments that are second 
associates of treatment j. Continuing this process, we obtain (s + 1) 
equations in (s + 1) unknowns, £j, Gin Ge, p) Gis. By imposing the 
condition that the sum of the #;’s is to be zero, i.e., that 


fj + Gi + G + Gis -0 


the equations may be reduced to a set of s equations in s unknowns. 

We shall derive an explicit expression for the case when there are z 

classes of associates only. The reader may refer to the paper by Rao 

for the solution for the case of 3 classes of associates. : 
With s = 2, the 3 equations in 3 unknowns are 

= Gn = n= Pj 

(Bip + S = Pa (34) 


afj 
unte, + (a — Bp — Bupa) Gn — 


Rah / — (ppi + BNap'ss)Ga + (a — Pein — Brsp*a)Gn = ZPa 


556 PARTIALLY BALANCED INCOMPLETE BLOCK DESIGNS 
Utilizing the relation that 
fj ＋ Gj + Ge =0 
we have the 2 equations, 
A'5fj ＋ B = kP; 


A'o2fj + B˙22071 = kZPj 
where 


4% = k(a + A3) = r[W(k — 1) + W"] + (W = D 
B'i2 = khz — X) = Qa — i) (W — W’) 
A's = kBdop?12 — UH — p^) 
= kBdop"12 — kB p12 = O Ni) p12 
= (W — ) = NID 


.and 
B's; = ka — kB (pii — Peli) — EDI — p^2) 
= r[W(k — 1) + W!] 
— (W — W^s(phi — 25) + lpi — Pe12)] 
Since : 
Pp'udpa-n-l 
and 
pP’ + p’ = m 
we have 
(51 — Pei) = —1 — (pii — p^) 
so that x 


Bla = r[W(k — 1) + W"] + (W — Wh + O — M) = 2^)] 
The solution of the equations is then 
1 
77 rs BD ; — B'is(kEP4)] (37) 


where E 
A’ = ABl — A'j5B'oi (38) 


and where, recalling our definition of Pj, 
Men 
kP; = WkQ; + wW’ (r, i 10 


= W(Q) + W'T; — rkW'y. 69) 
y.. being the over-all mean. . 
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Less work is involved computationally when n; is less than n, if we 
substitute for Gj, instead of Gj;. This gives the equations, 


$ A'uf$; + B˙110%½ = kP; 


(40) 
42 + B'Gj = KP 
where 
A'i = k(a + By) = [W (k — 1) + W'] + (W — Wry 
B’y, = kbA — N) = (W — W’) — da) 
A's, = KD + Ka — kona = kB(Arp'21 — Mp'ia) 
= (W — l = A)p'iz 
and (41) 
B'a, = ka + kpr (p'a — ^2) + KC — p°22) 
= r[W(k — 1) + W' 


+ (W — WYM (pa — p21) + Ne — p°22)) 
= r[W(k — 1) + W) + (W — W^ps + Ai — do) (P22 — p'22)] 


The solution of these equations is 


i ee vl B 2(kP32)] (42) 


where 
A! = A'yj B — A’ Bn (43) 
It may be noted that the two expressions for A' are identical alge- 


braically. : ; i 
The weights W and W’ are estimated by performing the analysis of 


variance in 2 forms as in Table 27.3. 


TABLE 27.3 ANALYSIS OF VARIANCE FOR PARTIALLY BALANCED ÍNCOMPLETE 
Brock DEsIGNS 


Sum of Sum of 
Due to Squares df Squares as dira 
1 : B M B' Blocks eliminating ien 
Blocks ignoring treatments ans T 7 b 


Treatments eliminating blocks Tt 
Error - Sg bk-b-t+1 Sg Error 


8 8 Total 


Total 8 bk- 1 
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In this table, 


1 
71 2 
y 


S LV CT 
D 


(grand total)? 
bk 


T' = iQ; 


Í; being the intrablock estimates, and Sg and B’ are obtained by sub- 
traction. 

We note that it is necessary to obtain the intrablock estimates, and 
these are given by the equations 37 or 42 with W’ = 0, that is, 


CT = 


1 
4 "t [B22(kQ;) — BioZ(kQji)] (44) 

where 

41 = r(k — 1) +e 

Biz = G2 — X) (45) 

422 = (Az — A) 12 

Bay = r(k — 1) + N + Qo — M) (phi — pi) 
and 


A = An — AssBis 


Alternatively, if ng is less than n, we may use the equation 


1 
i= ^ Bai — BiX(kQja)] (46) 

where 

Ay 7 r(k — 1) FN 

By = (Ay — X) 

An = Ai — N) (47) 

Bay = r(k — 1) +M + Oi — N20 7 — 12) 
* : 


A = Ay Ba, — AnBy 
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The expectation of the mean squares may be seen by noting that, apart 
from terms involving the 7;’s, 


E(S) = (bk — 1)e? + k(b — 1)c?; 
E(Sg) = (bk — b —t+ Do? 
E(T) = (t — 1)o? + (t Hoss 
so that 
E(B) = (b — % + (bk — Hess 


Denoting the mean square for error by E and for blocks eliminating 
treatments by B, we may then estimate W and W’ by 


1 8 
üt UT 36 -18-( — BE (48) 


The variance of an estimated treatment difference is found by the 
general procedure given in Chapter 6 for the 2-way classification. Con- 


sidering the intrablock information, the difference of 2 treatments, 7 
and 57, is estimated to be 


b RS i { Boa(kQ; 10 — Bis[Z(kQ) SH 


This expression must be written in terms of the V;’s, and, if it is equal to 


= ap Vy + ete. 


' 


the variance of the difference is (aj + ag,). If j and j' are first asso- 
ciates, V; occurs in Z(kQ;/) and Vy occurs in Z(kQ;), so that the vari- 


ance is 
2k 
P. (Bia + Baz)o? 
which equals 
^ 2k 
— Bayo” 
A 


If the j and j’ are second associates, V; and V; enter only through Q; 
and Qy, respectively, so that the variance is 


k 
2 j* Bogo* 
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We may note that the variance of the difference is less if the 2 treat- 
ments are first associates than if they are second associates, since 
Biz (= A. — M) is negative, because we numbered the X's so that 
1 > X. This merely states that the variance of the difference between 
2 treatments is lower, the more times the 2 treatments occur together 


in a block. 
By the same rule as for the intrablock estimates, the variance of the 


2k 
combined estimate of a treatment difference is A B21 if the treatments 


2k 
are first associates, and — B'»; if the treatments are second associates. 


'The average variance of treatment differences, using intrablock infor- 
mation only, is 


n 2k 2k 
TE 75 6˙4 — Ba heo 


I — 1)B22 + miBig]e? (49) 


(t— 91 
and the efficiency factor of the design is 


(t — 1)4 


rk{(t — 1)B22 + ni Bia] o 


The average variance of treatment differences, using both intrablock 
and interblock information, is 


a [(& — 1) B˙²e + n B^13] (51) 


27.6 A WORKED EXAMPLE 


. In Table 27.4 we give the results of a simulated partially balanced 
incomplete block design for 9 treatments in blocks of 3 plots. The re- 
sults we obtained as 
Vin = v0 + b; + ei 


where the b/'s were a random sample from a normal distribution with 
mean zero and variance of 100 and the e;;’s a random sample from a 
normal population of mean zero and variance of 25. 
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TABLE 27.4 


w 
i 
S 
È 


54 (3)  56(8 53 (4) 163 
35 (2) 36 (00  40(4 111 
48(1) 42 (7) 43 (5) 133 
46 (7)  56(8 59 (9) 161 
61(4 61(5) 54 (6) 176 
52 (3) 53 (9) 48 (5) 153 
54 (1) 59 (80) 62 (6) 175 
45 (2) 46 (9) 47 (6) 138 
3160 28 ½ 25 (8) 8⁴ 


€ o A oo fF Q t m” 


Grand Total 1294 


The parameters of the design are: 
129, k=3, r=3, b=9 
M = 1, ni = 6, à = 0, n = 2 


1 G y 1. 60 2 
Du 2 o/ [A] 0 1 


The quantities that must be obtained to complete the intrablock esti- 
mation and analysis are as follows, where we use the formulas 46 be- 


cause n, is greater than ng: 


Ay 7 r(k — 1) + = 7 
An = Mi — N =2 
By = NMI — do =} 
B4 = r(k —1) ＋ NM ＋ Ar - 2)(p?22 — plo) = 8 

A = ABa — 42111 = 54 


The estimation equation is then 


8(3Q) — Z(3Qj2) 


lj x 


and the sum of squares for treatments eliminating blocks is 1421,37) 
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4 
The computations are given in Table 27.5. 


TABLE 27.5 ` COMPUTATIONS FOR THE EXAMPLE 


Intra- 

Treatments 407 = 3Q; 2d block Combined 
j Vj Tj —3V;— T; Associates (072) 77 Pi Pr ^ Estimate 

1 3 302 Ma 4.9 34 — 041 0.12 090 — 0.08 

2 108 333 -9 5.8 8 —1.48 —0.36 0.33 —2.31 

3 131 400 -7 6.7 —33 —0.43 —0.22  —0.78 —0. 75 

4 154 450 12 1.9 29 1.24 0.32 0.70 1.38 

5 152 402 -6 2.8 5 —0.98 —0.11 0.08 —0.69 

6 163 489 0 3.7 —40 0.74 0.08 —1.08 1.20 

7 124 405 -33 3.6 - —4.76 —0.86 —0.14 —4.89 

8 171 499 14 2.5 -15 2.35 0.44  —0.47 2.87 

9 158 452 22 1.4 19 2.91 0.58 0.44 8.05 
Sum of column 1294 3882 0 0 0 —0601* —002* —0. 

=3 * 1294 


* Are unequal to zero because of rounding-off errors. 


ANAIATSIS OP VARIANCE 


Sum of Sum of 
Due to Squares df Squares Due to 
Blocks ignoring treatments 2520.52 8 1473.3 Blocks eliminating treatments 
‘Treatments eliminating blocks 97.99 8 1145. 18 Treatments ignoring blocks 
Error 133.34 10 133.34 Error 
Total 2751.85 26 2751.85 Total 


'The estimated variance of the intrablock estimate of the difference of 
2 treatments is 


2 X3 X Ær X 13.33 = 11.85 if they are Ist associates 


and 


2X3 X $r X 13.33 = 13.33 if they are 2d associates 


The efficiency factor of the design is 


8 X 54 


8X38X8L2x1) ^ 


If then the reduction of block size from 9 units to 3 units resulted in a 
lowering of variance within block by about l4, the design has proved 
to be of value without using the interblock information. It is not pos- 
sible to estimate this reduction in variance unless the design is resolv- 
able and the property was utilized in the experiment. 
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Turning now to the extraction of the interblock information, we com- 
pute the following quantities: 


E = 13,334 B = 184.17 
1 
r = 0.0750 
13.334 
18 
w= = 0.00415 
24 X 184.17 — 6 X 13.334 
w' f 
z—— Jedi = 0.2312 
6 p ;) 

Az = Ao(w — w’) ro =0 

Al = NIC - vw’) = 0.0708 
A'j9 = R(k — 1) + A2 = 0.4624 
4˙22 = (Aa — A) p12 -0 
B12 = Ao — A1 = —0.0708 
B'a = A's + B'a(phi — phi) = 0.6748 

A! = Ali — A'22B'12 = 0.31203 
A^u = Rk = 1) + Ay = 0.5332 
A's, = (A1 — A2) Pl = 0.1416 
By, = Ai — A2 = 0.0708 


B'a, = A'n + B'u (p22 — b) = 0.6040 
4 4 ¹¹B˙⁰¹ ec A’ By = 0.31203 
The estimates are given by the equations 


k 
77 7 (52 B Pa) 


where 
w w’ $ 
Pj NOU Ed Y. 
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In this case, 
P; = 2 opis T; — 3 X 0.00415 X 47.926 
= E BE Xs — 0.5967 
and 3 
. 77 031394 X 0.6048P; — 0.0708ZPja 


= 5.80P; — 0.68ZPj; 


The variance of a treatment difference utilizing both interblock and 
intrablock information is 


2k 
7G B21 = 11.01 if the treatments are Ist associates 


+ 
and 


2k 
55 B22 = 12.98 if the treatments are 2d associates 
* 
We note that the utilization of the interblock information has resulted 
in a trivial lowering of variance. In general, we would find out if such 
were the case before undertaking combined estimation. 


27.6 THE ENUMERATION OF PARTIALLY BALANCED 
INCOMPLETE BLOCK DESIGNS 


Partially balanced incomplete block designs include, as a special case, 
completely balanced incomplete block designs, and the same methods 
may be used for enumeration. A brief review only of these methods 
will be given, and the reader may refer to Bose and Nair! for a com- 
plete discussion. 


27.6.1 Geometrical Configurations 

Several designs arise by translation of geometrical configurations: 
e.g., the Desargue configuration of 
2 triangles in perspective gives rise 
to a design for 10 treatments in 
blocks of 3. If we take any regular 
polyhedron and regard the points as 
treatments and the faces as blocks, 
we get a partially balanced incom- 
plete block design. For example, with 
Fravm 27. a cube (Figure 27) we get the design 
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(1, 2, 3, 4), (1, 2, 5, 6), (1, 4, 5, 8), (2, 3, 6, 7) 
(3, 4 T, 8), (5, 6, 7; 8) 


In this case there are 3 classes of associates. Taking 1 as the fixed 
treatment, treatments 2, 4, and 5 are first associates occurring twice 
with treatment 1 in a block. Treatments 3, 6, and 8 are second associ- 
ates occurring once with treatment 1 in a block, and treatment 7 is a 
third associate occurring not at all in a block with treatment 1. The 
parameters of the design are: 


t=8 b=6, k=4, r=3 
392, ni = 3; Ag=l, m=3; J =, m= 1 


0 2 0 2.0. 1 03 0 
pg2|20 1| »5-|[02 05» = 3 0 0 
01 0 1320 000 


14 
Efficiency factor = — 
17 
This design mey also be regarded as a 2° lattice in blocks of 2? plots. 
The k X k simple lattice in a sense arises in this way, having param- 
eters: 
t=, (252, b=2k, * = k, r=2 


ni =2k—-1), 4 = 1, m=(k- 1, 2 =0 


1 _/k-2 k-1 ' 2 2(k — 2) 
pig ( ' Pij = 2 
k—1 (k—1)(k — 2) 2(k—2) (k — 2) 
Any k” quasifactorial design in blocks of ku plots with n different 
replicates is a partially balanced incomplete block design. The design 


is a geometrical configuration one since it is obtainable by taking sets 
of (n — 1)-dimensional hyperplanes from an n-dimensional lattice. 


27.6.2 Application of Finite Geometries 

A general method of obtaining partially balanced incomplete block 
designs is to exclude from EG(k, p") the origin (0, 0, «++, 0) and regard 
the remaining points as treatments. We then take as blocks all the 
(k — m) flats that do not contain the origin. 

To obtain partially balanced incomplete block designs from PG(k, p", 
we exclude any one point, say (1, 0, 0, +++, 0), and regard the remaining 
points as treatments. Blocks are formed by taking all (k — m) flats 
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that do not contain the excluded point. We note in passing that, with- 
out excluding these points, and taking all (k — m) flats as blocks, we 
obtained some of the completely balanced incomplete block designs of 
Chapter 26. : 

As examples, we quote the following from Bose and Nair's paper: ! 


1. EGG, p") with k = 2, m = 1.* The number of treatments is 
s? — 1, where s = p". The parameters of the design are found to be: 


M21, m-2s$-—s 


TRI (ea Ep „ 0 
“a as 0 7 = ( 0 E.) 


With s = 22, if the 15 treatments being denoted by (ij), 7,7 = 0, 1, 2, 3, 
excluding (00), the blocks are as shown in Table 27.6. 


> 
[3 
Li 

LI 
= 
8 
ll 
an 
I 

nN 


TABLE 27.6 


(10, 11, 12, 13) (20, 21, 22, 23) (30, 31, 32, 33) 
(01, 11, 21, 31) (02, 12, 22, 32) (03, 13, 23, 33) 
' (10,01, 32, 23) (20, 31, 02, 13) (30, 21, 12, 03) 
(10, 31, 22, 03) (20,01, 12, 33) (30, 11, 02, 23) 
(10, 21, 02, 33) (20, 11, 32, 03) (30, 01, 22, 13) 


2. PG(k, p") with k = 3,m = 1. The parameters of the design are, 
with s = p", as follows: 


t UT, bes, ree, kel 
AL = 3, m = 8° + 87; 2 = O0, n2 = 8 — 1 


„9 -( pen net 19 
$41 0 es 0 4-2 


Similarly, we can cut out points of a particular m flat and take all 
(m + 1) flats except those that contain the excluded m flat as blocks. 
For example, we may remove all points on a line from PG(3, p") and 


It should be noted that k in EG(k, p") bears no relationship to k the size of the 
block. Which & is meant is always clear from the context. 
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take as blocks all planes that do not contain the excluded line to give 
a design with the following parameters: 


= ＋ , bas+s, = s, k=f+s 


u = 3 ＋ 1, m=8; h e, n 1 


: 8 — 82 52 — 1 1 0 
bir 92 — 1 0 f Per 0 -2 


27.6.3 The Method of Differences 

The reader should refer to Bose and Nair's paper for a description of 
this method. The designs are obtained by the use of moduls. An ex- 
ample is the design 


(124) (235) (340) (451) (502) (013) 


for 6 treatments, denoted by 0, 1, 2, 3, 4, 5, in blocks of 3 plots, the 
parameters being 


This design is interesting mainly as a product of the method, it being 
generated by addition from the first block, the rule of addition being 
the ordinary one with reduction modulo 5. 


27.6.4 Other Methods 
Some simple ways of obtaining designs are as follows: 


1. If £ = pq, arrange the treatments in a p X g array, and take for 
the pq blocks each treatment and the treatments that occur with it in 
a row or in a column. 1 z 

2. Using the same array, form pq blocks by taking all the treatmen 
that occur in a row or a column with each treatment, excluding the 
treatment itself. 

3. If p = q, a Latin square may be constructed, and all treatments 
having the same row, column, and letter as each treatment make up a 
block. É 

4. Given an incomplete block design, it can be inverted if treatments 
are renamed as blocks and blocks as treatments, and this sometimes 


gives another incomplete block design. 
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27.7 CONCLUSION 


From the viewpoint of the experimenter, we may regard the incom- 
plete block design problem as solved for all practical purposes with 
perhaps a few exceptions. The choice between various incomplete block 
designs and lattice designs is based primarily on the size of block de- 
sired and the number of replicates possible. With designs that have a 
low number of replicates, the efficiency factor is important, if there is 
doubt concerning the accuracy of the utilization of interblock informa- 
tion because of a low number of degrees of freedom for blocks. 

The designs have been chosen primarily on the basis of the simplicity 
of the analysis. Many other designs which appear offhand to be rea- 
sonable are not practical on this basis. For example, a design for 50 
treatments in blocks of 4 may be generated by taking as the initial 
block (0, 1, 2, 3) and adding (modulo 50) 1, 2, 3, - - +, 49, respectively, 
to give 49 more blocks. Such a design is, however, difficult to analyze, 
because it is necessary to invert a 50 X 50 matrix, which is very tedious, 
even though the matrix is of a particular type, known as circulant.* 

Further developments of partially balanced incomplete block de- 
signs are discussed by Rao? and Nair and Rao.“ For example, other 


designs may be included in the class if the \’s are not restricted to be 
unequal. 
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this type of design, and the matter will be dealt with in a paper. 


CHAPTER 28 


Experiments on Infinite Populations 


and Groups of Experiments 


28.1 INTRODUCTION 


We have considered the more important designs involving 1, 2, 3, or 
more factors from the point of view of both design and analysis. It 
should be noted, however, that we have always restricted ourselves to 
a discussion of the effect of the factors at the levels actually tested. 
There is a whole class of experiments which have the common feature 
that they involve factors or pseudofactors with a large, and often infi- 
nite, population of possible levels of the factors. For instance, we may 
take the 1-factor case, in which we are interested in the yields of a pop- 
ulation of varieties of corn, but can, of course, test only a finite number 
of the varieties in an experiment. Again, for the 2-factor case, we might 
be interested in the differential effects of a number of nutrient treat- 
ments on a large population of varieties of corn. We can do no more 
than test the treatments on a sample of the population of varieties, but 
we are interested in the effects of the treatments on the whole popula- 
tion of varieties, possibly even more than in the effects of the treatments 
on the actual sample of varieties used in the experiment. For the 3- 
factor case, a.typical and frequently occurring example is the compari- 
son of a fixed set of varieties or treatments over a large population of 
places and a large population of years. The experiment we actually 
make must involve only a sample of the population of places and a 
sample of the population of years. The problems encountered have 
come to be known as the problems arising with a series of experiments 
(Cochran, Yates and Cochran °). In this situation, the experimenter 
is often interested not only in the determination of effects for the indi- 
vidual experiments given by particular choices of place and year, but 
also in the effects for the population of possible years with a fixed place 
and the effects for the populations of possible years and possible places. 
In fact, the whole program of hybrid corn breeding in the United States 
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is based on precisely this situation, and problems of design and analysis 
arise (cf. Federer.and Sprague? for example). We shall endeavor in 
this chapter to give a unified discussion of this type of problem. 

There are essentially two aspects: namely, the design of the whole 
experiment, which will include a discussion of the number of levels of 
factors that should be tested, and the interpretation of experimental 
results. It is intuitively clear that, in the absence of a priori informa- 
tion, the experiment actually made gives the best point estimate of a 
treatment effect for the whole population, even though this estimate is 
the estimated effect for the sample of levels actually used. In applying 
the estimate to the whole population of levels, we must take account of 
the fact that we have used only a sample of levels, and the error of the 
estimate will contain additional components of error. As a result, we 
shall become involved in the estimation and interpretation of compo- 
nents of variance. The estimation of components of variance was dis- 
eussed in Chapter 6, and the reader may find it necessary to refer to 
that chapter. 

The problems that arise are.of very wide occurrence, and, although 
we shall couch them in agronomie terms, the reader should have no 
difficulty in translating the concepts into the language of engineering, 
psyc’ ology, education, and any other subject-matter field. 


28.2 THE 1-FACTOR EXPERIMENT 


Suppose we can obtain a new population of varieties of corn, for ex- 
ample, by breeding from a cross of two varieties of different geographic 
origin. We shall wish to determine characteristics of this population, 
and, confining ourselves to one attribute, say, yield, we shall wish to 
obtain knowledge on the distribution of the yields of the possible varie- 
ties that we can obtain by a particular breeding program. It is probably 
reasonable to assume that the yields of the possible varieties are dis- 
tributed normally, and we would then wish to obtain an estimate of 
the mean x and the variance c?, of the distribution. To do this we shall 
perform the steps of the breeding program and obtain a random sample 
of, say, v of the possible varieties, which we shall test in a replicated 
experiment with randomized blocks. Insofar as the mean à will de- 
pend markedly on the environment in which the varieties are grown, 
while the variance may be more stable, we shall concern ourselves main! y 
with the estimation of o”,. Knowledge of ¢”, is important, for we know 
that, if we adopt the rule of taking the top p percent of a random sam- 
ple of size v of the varieties we generate, the selection being made on the 
basis of the observed means of the v varieties which are each subject 
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to a variance of c?,, then the difference between the true mean of the 
selected p percent and the mean of whole population will have an ex- 
pectation of Ke? 

v 


Vo, + 07» 


where K depends only on p and v (see Yates,‘ for example, or any text 
on selection in genetic material, such as Lush 5). Given estimates of 
c?, and c?,, we can say whether it is worth our time to work on the 
population to extract the higher members. The formula we have given 
is also interesting in that it demonstrates the importance of reducing 
a?e by the experimental design. 

Suppose that we test the sample of » varieties with r randomized 
blocks of v plots. Assuming that the yields y;; are given additively, we 
use the model 


yg = B+ bi + vj + ei 
where 


i = block number = 1, 2, „ 7 


variety i 1/2, c5. 


j 


vj 


normal independent random variables with 
mean zero and variance c?, 


and the eis are uncorrelated with a mean of zero ànd may be assumed 
to have constant variance c. 

We have found that the expectations of mean squares in the analysis 
of variance are as given in Table 28.1. 


TABLE 28.1 
a Mean - Expectation of 
Due to df Square Mean Square 
Blocks r-i 
Varieties 1 v + 22 (v, he 
Error (r — (v — 1) E o 


Since the »,’s are random variables from a normal distribution with 
variance o”,, the expectations are 


E(E) = &? 
E(V) = e? + re, 


„ )*. 


and 
so that 
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We may estimate c? and o°, by these equations. Under the infinite 
model; (r — 1)(v — 1)E and (v — 1)V will follow x? distributions inde- 
pendently. The variance of the estimate 62, is then 


2 ES + ro*,)? 4 (0)? | 
à (v — 1) (r — 1)(v — 1) 


This formula may be used to estimate the number of lines and replica- 
tions that should be used to obtain a satisfactory estimate, given an 
idea of the values of c? and c?, that will be encountered. We gave a 
simple illustration of the use of this formula in Chapter 6. 

The test of the hypothesis that c? = 0 is easily made by the F test. 
The same test may be obtained by applying the likelihood ratio cri- 
terion to the joint distribution of the y,;’s under normality assumptions. 
A test of the hypothesis that o°, = k, unequal to zero, does not appear 
to be obtainable easily. It is relatively easy to give a test of the hy- 
pothesis that c?,/c?, equals some constant, but such a hypothesis is not 
of practical interest, because o”, is essentially a property of the measuring 
device, namely, the experiment, whereas g”, is a property of the material 
being measured. We, therefore, expect c?, to be relatively constant, 
while o may vary with the type of experimental material (i.e., field 
plots in the present case) on which we obtain the measurements, and 
with the experimental design used. 

If we were interested in the mean of the population of varieties, a 
problera of allocation of resources arises, because the variance of the 
observed mean about the true mean of the population, that is, the mean 
we would get if each member of the population were tested on the set 
of plots used, is 


T 


a+r, s, oF 
v 


rv TV 


This formula is instructive in indicating that having considerable rep- 
lication of a chosen sample of varieties is less important than choosing 
a large sample of varieties, and, consequently, having less replication 
per variety. 


28.3 THE 2-FACTOR EXPERIMENT 


An example of the type of problem we shall discuss is the testing of t 
treatments on a random sample of v varieties. There are several de- 
signs possible for such an experiment, and we shall first consider the 
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case when randomized blocks of vt plots are used. The mathematical 
model we shall use is 


Wk = 1 + bi t + ve + () + eijk (1) 


i = block number = 1,2, -r 
j = treatment number = 1, 2, ---,¢ 
k = variety number = 1, 2, „ 


and u, bi, and £j are unknown constants, the other terms being random 
variables. The additive effect of treatment j in combination with va- 
riety k consists of 3 parts, £j, vy, and (t) i, of which t; is a fixed constant 
and the v,'s and (iv);;s are random variables because we have taken a 
random sample of varieties. We may assume that the expectations of 
v, and of () are zero, so that ¢; is the true effect of treatment j over 
the whole population of varieties. We shall assume the vs to be nor- 
mally distributed with variance c?,, and the (tv);’s to be normally dis- 
tributed with variance a?i» which does not depend on j ork. As usual, 
we may assume the eis to be uncorrelated with mean zero and con- 
stant variance 2. We suppose that the object of the experiment is to 
obtain estimates of the differences between the ¢,’s and the errors of 
these estimates. The structure of the analysis of variance is given in 
Table 28.2. 


TABLE 28.2 STRUCTURE OF ANALYSIS OF VARIANCE FOR RANDOMIZED BLOCK Ex- 
PERIMENT OF | TREATMENTS WITH A RANDOM SAMPLE OF v VARITEIES 


Mean 

Due to df Square Expectation of Mean Square 
Blocks r-1 
Treatments 1-1 T o? + ron + 22 1 Dit, — D 
Varieties v—1 y a? + ro + rio% 
Treatments X varieties (t 9 — 1) I e? + ros 
Error (r — (te — 1) E o? 

Total ri» — 1 


In writing down the expectations in the above analysis of variance, 
we have assumed that the (tv);’s are normally and independently dis- 
tributed around a mean of zero and with variance c?,, (cf. Chapter 6). 
Since we have only a finite set of fixed treatments, it is reasonable to 
define the »,’s in such a way as to measure the differences between vari- 
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eties averaged over this set of treatments. If we do this, the quantities 
(tv) jx are such that 


Dd (to) = 0 for any k 
7 


The expectation of the mean square for varieties should, therefore, be 
c? + rto?» the term in 2% dropping out, because the sum of squares 
for varieties is the sum of squares between variety totals with a certain 
divisor. This illustrates a generally applicable device, that, if we are 
considering a fixed set of levels of factor a with a random set of levels of 
factor b, the expectation of the sum of squares for factor b does not 
involve the interaction component of variance. In other words, the 


1 
quantity o”, + — 074, should be replaced by o°», in the expectation of a 
a 


mean square in which it occurs, if there is a finite number of levels of 
factor a. 

If. we wish to test for the existence of differences between the ¢,’s, 
that is, differences between treatments averaged over all the possible vari- 
eties, we shall use the criterion T/I. This criterion will be distributed 
under the null hypothesis, according to the F distribution, with (f — 1) 
and (t — 1)(v — 1) degrees of freedom, because both treatment sum of 
squares and interaction sum of squares are distributed under the null 
hypothesis as x( + ro?;,) independently with the appropriate degrees 
‘of freedom. The plot errors are not independent as we have noted 
throughout this book, but all the knowledge we have suggests that we 
may ignore the dependence. It is also clear from the analysis of vari- 
ance that we may test the hypothesis that c equals zero by comparing 
I/E with the appropriate F distribution. 

For the reasons stated above, the hypothesis that there are no differ- 
ences between the varieties averaged over the set of treatments is tested 
by comparing the criterion V/E with the appropriate F distribution. 
If the treatments are a random sample from an infinite population, the 
criterion V/Z would be used to test the hypothesis that there are no 
differences between the varieties averaged over the population of treat- 
ments. If the treatments were a random sample from a population 
such that the /s are distributed with variance 2, the test with T/I 
would be a test of the null hypothesis that 92, equals zero. 

The best estimate of comparisons of the t;'s is given by the same com- 
parison of the treatment means: that is, of the y.;.’s. In any such com- 


1 
parison each y.;. has a variance of — (s? + ro which equals — T m 
TU v TV 
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It may be noted that, if 92% is large relative to 0”, it will be advisable to 
include a large number of varieties at the expense of the amount of 
replication, though a change in this direction will produce an increase 
in o”, because. the block size will be correspondingly increased. 

In fact, when an experiment apparently of the above type is per- 
formed, the experimenter has usually not selected a random sample of 
varieties, but a set that he considers worth examination. Frequently, 
however, he wishes to test hypotheses about treatment effects on a 
population of varieties, because he finds that treatment effects vary 
considerably over the varieties he used. He then takes the somewhat 
hazardous step of assuming that the varieties he used constitute a ran- 
dom sample of a population of varieties that he could have used, and 
wishes to talk not only about the varieties actually used but also about 
the whole population. This step is hazardous because the only defini- 
tion we can accept of a random sample is a sample drawn with a device 
known to produce randomness, for example, a table of random num- 
bers. It appears reasonable, however, to adopt this as a device to facili- 
tate condensation of experimental results, providing the limitations are 
realized, As a result, the experimenter tends to be in the position of 
attempting to answer both of the following questions: 


1. Are there differences between the treatments for the set of varieties 
used? i 

2. Are there differences between the treatments for the population of 
varieties of which the set used constitutes a random sample? 


He also wishes to estimate treatment differences over both sets of situ- 
ations. We have already discussed the test for question 2, and the test 
for question 1 is the comparison of T/E with the corresponding F dis- 
tribution, as in the case of the ordinary factorial experiment. The es- 
timate of a treatment comparison is the same for both cases, namely, 
the comparison of observed means, but the variance of each y.;. for the 
population of varieties is (e? + rf) /rv, while the variance for the par- 
ticular set of varieties is o?/rv. The error to be attached to an estimate 
depends on the use to which the estimate will be put. Let us suppose 
that the purpose of the experimenter is to predict the gain an individual 
farmer will make by using treatment 1 rather than treatment 0, and 
that the farmer is using‘a variety which is not one of those tested in the 
experiment, and one which may be assumed to be a random member 
of the population of varieties. Then the experimenter wishes to predict 


the quantity 
X = h - to + (w)u — (tv)ou (2) 
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where u denotes the number of the unknown variety y. The observed 
mean difference between treatment 1 and treatment 0 is y.1. — , 
and is an estimate of 


1 v LJ 
(1 — à) += | X @u- > A + plot error (3) 
v k=1 


k=l 
where the summation is over the varieties (1; ---, v) tested, and the 
expectation of the square of the plot error is 20% rv. 
Therefore, 
1 v v 
yi. — 0. =X+ 1 (1011 — 22 (oh. 
v Lk=l k=l 
— [(tv)au — (tv)o,] + plot error (4) 
80 that 
202 201 


Ellu. — .o.) — XP = ia $ + 26, 


v 


arat] e 


If we estimate c? and c?,, and substitute the estimates, we may say 
that the prediction of X is 


a 1 
ye f +44 (1+-)| 
F TU v, 


and, if the numbers of degrees of freedom are sufficiently large, the 
interval 


62 IN]. 
7.1. — yo: & 1.96 21 Pali + -J 
TU v 


will be an approximate 95 percent confidence interval on the true differ- 
ence for the farmer. Reasoning of the above type is necessary if sound 
technological advice is to be given to users of the experimental results. 

We will now consider the same pattern of treatment combinations 
but a different experimental arrangement. We will suppose that, for 
reasons of experimental technique, the experimental arrangement util- 
ized split plots, and that treatments were applied to whole plots, each 
whole plot being split into v parts for the varieties. The structure of 
the analysis of variance for this case is given in Table 28.3, where c?, is 
the split-plot error variance, and o°, + so” is the whole-plot error 
variance. 
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TABLE 28.3 STRUCTURE OF ANALYSIS OF VARIANCE FOR SPLIT-PLOT EXPERIMENTS 


M ean 
Due to df Square Expectation of Mean Square 

Blocks r—1 
Treatments t-1 17 c + veu roh + TET Z(t; — 2)? 
Error (whole plot) (r — 1)(t — 1) Wo + vo 
Varieties v—1 y e, + ro^, + rios 
Treatments 

X varieties (t — % — 1) a, + row 


d 


Error (split plot) (r — 1)t(v — 1) 


Total rly — 1 


This case is instructive in two respects. First, the test of T/W with 
the F distribution does not test the hypothesis that the %s are equal. 
It will be remembered that, in our discussion of split-plot experiments, 
we noted that the criterion T/W could be used to test for differences in 
the treatments averaged over the set of varieties used, and, if the % are 
defined for this set only, the term o, does not appear. Now, however, 
the ¢;’s are defined to be averages over the whole population of varieties, 
and the existence of the term rc?,, in the expectation of T prevents our 
using the ratio T/W. Second, the test cannot be made by comparing 
T/I with the corresponding F distribution because of the presence of 
the term vos, in the expectation of T. A third difference is that, if the 
treatments are a sample from an infinite population, we may use the 
criterion V/I to test the hypothesis that c?, equals zero: that is, that 
there are no differences in the population of varieties when averaged 
over the population of treatments. The reason that we can make this 
test is that we have assumed that the yield of the combination of treat- 


ment j and variety k is expressible as 
tj + ve + (t); + error 


where the (tv);’s are independent normal random variables with mean 
zero and variance c?,,. Tests of the hypothesis that the hs are con- 
stant can be suggested on the basis of the expectations of the mean 
squares, on the lines suggested by Satterthwaite) We have, for ex- 


ample, * 
E(T) = . + ve + rh + 12. p 


EW +I — 8) = ch ve I 4, K rh o, 
= 62, + vols + ro? 
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so that the ratio T/(W + I — S) could be used as a criterion if we knew 
ts distribution. Alternatively, as suggested by Cochran and Cox, we 
have : 


EGT +8) = 202, + vo? + roo, + = z(y- De 


E(W + I) = 207, + vo?, + T0? 


so that we could use the criterion (T + S)/(W + J), if we knew its 
distribution under the null hypothesis. We know that (r — 1)(t — 1)W 
is distributed as x(, + vow), (t— 1) — 1)I as x?(e^, + ro’), 
(r — 1)t(v — 1)S as x?c?,, and so on, with the appropriate number of 
degrees of freedom for each x’, the distributions being independent. 
Now, if u Ei is distributed as x?c?;, and n3Es is distributed as x50, 
then, 


2 
var (EI) = 2 e var (Ej) = 2 (^) 
ny N 


If E, and E» are distributed independently, then, 


(071)? ae 


ni no 


var (Ei + Ea) 21.5 


If we are to regard (E, + Ea) as the numerator or denominator in an 
F test, then we should have 


( + 079)? 
n 


var (Ei + Ea) = 2 


where n is the degrees of freedom. We may, therefore, regard Su + E2) 
as being distributed approximately as x?,(o?, + o *2), the x? having n 
degrees of freedom, if 


(07; + 039)? T (1 + 07»)? 
V(E, + EZ) — (sy n (079)? 


n n2 


Since we do not know o°; and 79, we replace them by their estimates 
E, and Ea, so that we assume as an approximation that n(E, + Ez) is 
distributed as x + 072), where 
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co Qn + Es)? 
E, E’ 
55 
"n no 
In the present instance, we would test the hypothesis that the t;’s are 


equal by comparing the ratio (T + S)/(W + 7) with the F distribution 
with n; and ng degrees of freedom, where 


(T +5) 
m 7. TP ga 
fe + oie "1 
and (Ww De (6) 
Nng = 


wW? 72 
E — t - 1) s ( — 1)(v — "1 


Alternatively, we may compare T/(W + I — S) with the F distribu- 
tion with nı and ng degrees of freedom, where 


n =t-1 (Ww +1-8)? 
MINES Lue ESSET 
nt Ww? P 82 (7) 


(r - (t — 1) taps 1)(v — 1) 7 1)t(v — 1) 


It is not known how reliable these tests are. It might be expected 
that the test based on T/(W + I — S) would be better, in that the dis- 
tributions of W, I, S are closer to normality than that of T because 
their numbers of degrees of freedom are larger. At best these tests are 
very crude. The results of Robbins and Pitman * may be’ used to give 
levels of significance with a bounded error, but the process is probably 
rather tedious. 

A situation in which recourse must be had to the above test is the 
following. We wish to determine the effects of £ treatments, which con- 
sist of different methods of cold storage, on the flavor of a food. A 
randomized block experiment of r blocks of t plots is used, and, in order 
to determine the flavor of the resulting food, the contents of each plot 
are divided into portions, one for each of j judges. The allocation of 
portions to judges is made at random. The scores of the judges are 
then subjected to the analysis of variance, though, before this is done, 
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some a priori information on the additivity of scores is necessary. The 
analysis of variance has the form given in Table 28.4. 


TABLE 28.4 
Mean 
Due to df Square Expectation of Mean Square 
Replicates r-l j 
Treatments P T 165 + jet, tron E 721 x(t; — d 
Error (plot) = = W . ＋ J 
Judges 121 Je, Te rte, 
Treatments X judges (t — 1)j—1) I X + rej 
S g 


Error within judges (r — 90 — 1) 
Total rij 1 


The significance of treatment effects for the set of judges used is given 
by the ordinary test: namely, to compare T/W with the F distribution 
with (¢ — 1) and (r — 1)(t — 1) degrees of freedom. If it is assumed 
that the judges used are a random sample of a population of judges, it 
is necessary to test the null hypothesis that there are no treatment 
effects by the criterion T/(W + J — S). It is usually found that judge- 
treatment interactions are considerable, and that, while there are highly 
significant treatment effects averaged over the set of judges actually 
used, the significanee of treatment effects for the population of judges 
is much lower. Most of the difficulty appears to arise in practice, be- 
cause the scores are not even approximately additive in mean, replicate, 
treatment, and judge effects, and this suggests that the scaling problem 
is all-important. A scale on which judge-treatment interactions are not 
small, relative to the error within judges, will be very insensitive to 
treatment effects, and will make the detection of effects very difficult. 
It is also likely that c?;, and o°, will not be homogeneous, some judges 
having little discriminatory power and good reproducibility and others 
the reverse. Even though the experimenter has not chosen judges at 
random, it does not appear satisfactory to consider tests and effects 
with the fixed set of judges, unless the same set of judges can be used 
for all experiments, because the experimenter will find that his experi- 
mental conclusions are not reproducible. "The estimation of compo- 
nents of variance, even on a scale that is only roughly additive, is useful 
` in that it gives an indication of the number of replicates and judges 
necessary, for the variance of a treatment mean is 

2 
CC 
7) 1) T 3 
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The dominant part of this variance is likely to be the term /,, in- 
dicating that the number of judges should be large. In planning an ex- 
periment of this type, it is essential to obtain some prior notions about 
the components of variance, in order that the experiment may have 
adequate sensitivity.. The difficulty will be encountered that any change 
in j, the number of judges, will have an effect on o°, and , because, 
if the portion that the judge tastes is to be of constant size, an increase 
in j must be accompanied by an increase in the size of experimental 
unit and of o°, and c?,. It is believed, however, that the change in o°, 
and c?, will not be sufficiently large to vitiate completely a calculation 
of number of replicates and judges necessary, based on constant values 
for o,, o and G. In the author's experience a very large number of 
experiments have been performed on this type of problem, which would not 
have been done had some examination of probable sensitivity been made. 


28.4 THE DESIGN AND ANALYSIS OF A SINGLE SERIES 
OF EXPERIMENTS 


A single series of experiments consists of an experiment repeated over 
a sample of a single population. For example, we may be interested in 
the responses of a crop to differing amounts of nutrients over a geo- 
graphical area and, for that purpose, choose a random set of p locations, 
at each of which we have an experiment on the nutrients. There are 
essentially 4 cases, depending on the design of the individual experi- 
ment, in that the individual experiment may utilize a randomized block, 
Latin square, incomplete block, or split-plot design. The 4 cases differ 
only in minor but important respects, and we shall not discuss them all 
in full detail. In a single series of experiments we will generally be in- 
terested in both the individual experiments and in the series of experi- 
ments as a larger experiment. 

We consider first the case of a randomized block experiment on ¢ 
treatments in r blocks of ¢ plots repeated over p places. The yields at 
the ith place will be given by the usual model 


Yije = ut + bij + tit eig (8) 
where 
i = place = 1,2; P 
j= block within place 1, 2, „7 
k = treatment = 1, 2, „f 


by; = the effect of the jth block at the ith place 
ti, = the effect of the kth treatment at the ith place 
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and the es are errors with mean zero, zero correlation (because of 
randomization) and constant variance 92. 
We may perform the analysis of variance in the usual way for each 
place and obtain tests of significance and estimates of.effects with errors, 
' and this should be the first step in the analysis of the series of experi- 
ments. We shall then wish to test and estimate the treatment effects 
for the population of places of which we have a random sample. The 
model we may use for the whole set of experiments is 


Vk = u F Pi + bg + t (a + ei (9) 
in which we have written 
hi = u + Di 
tk + Cot) ix 


The treatment effect at place i has been expressed as the sum of a com- 
ponent be, which is constant for all places, and a component (plis, 
which measures the deviation of the effect at place i from the mean 
effect over all possible places. By definition, the component (pf), has 
an expectation of zero, and we shall assume that its variance is dip in- 
dependently of i and k.. The es may be assumed to be approximately 
normally and independently distributed with mean zero and variance 
02. Regarding the terms in the model apart from en us fixed variables, 
we have the ordinary general linear hypothesis model from which we 
derive the analysis of variance given in Table 28.5. In taking expecta- 


lik 


TABLE 28.5 STRUCTURE OF ANALYSIS OF VARIANCE FOR AN EXPERIMENT 
REPEATED OVER PLACES 


Mean 
Due to df Square Expectation of Mean Square 

Blocks within places pir — 1) 
Places p-1 P 
Treatments t-1 T o? + ros + 12 O 0? 
Treatment X places (t — 1)(p — 1) I o + ro%ip 
Error P(r — 1)(t — 1) E 

Total prt —1 


tions, however, we utilize the assumption that the (pt)as have a vari- 
ance of c^. 

The interpretation that is made of the analysis of variance is obvious 
from the expectation of the mean squares. We test the hypothesis that 
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the ¢;’s are constant by the criterion T'/T, and that the interactions are 
zero, that is, that op is zero, by the criterion I/ E, in each case using 
the appropriate F distribution. The estimate of a treatment compari- 
son will be the same comparison of the observed means, y. ,; and the 
variance of the observed comparison as an estimate of the comparison 
of the ¢,’s, that is, of the treatment effects averaged over the population 
of places, is proportional to 


rp p 

The variance of a comparison of the y..;, as an estimate of the com- 
parison of the treatment effects averaged over the set of places actually 
used, is on, the interaction component dropping out because of the 
restriction on the population about which the inference is made. The 
problem of allocation of resources may be discussed if the prime interest 
is the estimation of treatment differences for the population of places, 
for we may then suppose that the cost of the set of p experiments is 


proportional to > 
nC, + rpCy = Co 


where Ci is the cost of the experiments per plot, Cy is the additional cost 
per experiment. (consisting of, for example, travel time to the different 
places), and Co is fixed. The optimum number of replicates at each 
place is given by 


Cpo? 
01 e^t 


and it may be noted that, with fixed costs, the optimum number of 
replicates per place decreases as c^, increases. In practice 2 replicates 
are desirable at each place, in order to provide an estimate of o°, and 
in many situations this is also the optimum number. 

Assuming that the analysis for the individual experiments are valid, 
there are two possible difficulties which vitiate to a greater or less extent 
an interpretation based on the analysis of variance given in Table 28.5. 
The difficulties are: 


1. That c? is not constant. d 
2. That % depends on the combination of treatment and places. 


The assumption that s? is constant may be examined by Bartlett's 
test. It is possible that the variation in c? is a result of non-additivity, 
and may be overcome by a transformation of the data, but, in general, 
a? will vary from place to place because the experimental material is 


r= 
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not of constant variability. This situation has been discussed by Coch- 
ran! and by Cochran and Cox,’ but it is very complicated mathemati- 
cally, and only very approximate solutions are available. Since the 
mean effect over all possible places would be estimated by 4, which is 
the solution of the equation 


33 =0 (10) 


Z 
(c 
r 


where 4; is the estimate for the ith place, even if the c”,’s are hetero- 
geneous, the unweighted average of the ;'s will give a fairly good esti- 
mate of the mean y for the whole population of places. Only if there 
are no interactions, would it be appropriate to weight each 7; by its 
estimated error variance, say, s*;/r, and even then the s?;'s should be 
based on 15 or more degrees of freedom for the weights to be sufficiently 
accurate, 

The test of interaction of treatments and places is rendered complex 
by the occurrence of heterogeneity of error variance. A test may be 
derived by assuming that the variance of each treatment-place mean 
which is c?;/r is known exactly. Then, if we denote /o, by W;, a test 
for interaction may be obtained (1) by minimizing the quantity 


UWL ee =u = pe— th)? 


and obtaining J, and (2) by noting that I is distributed according to the 
x’ distribution with (p — 1)(t — 1) degrees of freedom under the null 
hypothesis that interactions do not exist. Since we do not know the 
c? s, we use w; = r/s?; where 8°; is the observed error variance, but, 
as a consequence, the quantity J is not distributed exactly as x? with 
(p — 1)(t — 1) degrees of freedom. Cochran and Cox ? have stated that 
I is such that we may regard E 


(n — 4)(n — 2) 
n(n + t — 3) 
as being distributed according to the x? distribution with 


(n — 4) 


— 10 — 1) ——— —— 
o- t=) os 


degrees of freedom. Actually, I is equal to 
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i t k w 


where 
Y;..= Dy, and w= Dw 
k 


If there are differing numbers of replicates at each place, but the ex- 
perimental error variances are constant, the above method may be 
used with w; = r; and the quantity 7 will be distributed exactly as 
xo with (p — 1)(t — 1) degrees of freedom if there are no interactions. 
If the observed error mean squares and number of degrees of freedom are 
82, and ny, respectively, then, under the assumption of constant c?, the 
quantity En;s?; is distributed as xo with Zn; degrees of freedom. We 
may, therefore, use the criterion 


^ I Vie 

(p- Dt -1/ Zw 
which will be distributed exactly according to the F distribution with 
(p — 1)(t — 1) and En; degrees of freedom, if there is no interaction. 

If there is heterogeneity of error variance but the interaction compo- 

nent % may be assumed to be homogeneous or if there are differing 
numbers of replicates, an approximate test of significance for the effects 
of treatments averaged over all places may be made by obtaining the 
analysis of variance of the treatment-place means indicated by Table 
28.6. 


TABLE 28.6 STRUCTURE OF ANALYSIS OF VARIANCE OF TREATMENT-PLACE MEANS 
Due to df Expectation of Mean Square 

Places p-1 

_P_y 2 

Treatments t-1 om + % + Pci X(t — D 


Treatments X places (p =- It — 1) o'm + oip 


Total p-1i 


In this table c?, is equal to 
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where c?; is the error variance, and r; the number of replicates at place 
i. Differences between the tz's must be estimated by the differences of 
the means over places of place-treatment means, and each mean will 
have a variance of 


(07m + 071) 
p 


The quantity c?, will be estimated by 


where the s*;’s are the individual observed error mean squares. 
Heterogeneity of interaction variance, that is, a dependence of c?,, on 
place and treatment, is likely to be of frequent occurrence. For ex- 
:ample, at one place, the experimental material may be unresponsive to 
all the treatments, while, at another place, there may be little response 
to a few of the treatments and very large responses to other treatments. 
Such situations will be brought to light by examination of the analyses 
of the individual experiments, and there will be little interest in an ex- 
act test of the hypothesis that all the £j's are equal to a constant. The 
devices that may be suggested are the same ones we considered for in- 
dividual experiments: namely, transformation of the data, or a parti- 
tioning of the treatment comparisons into orthogonal comparisons. 

We have discussed only the case when the individual experiment, is 
in randomized blocks. If the individual experiment is in Latin squares, 
the same considerations hold except that the sum of squares for rows 
within experiments and columns within experiments must be extracted, 
with a compensating change in the degrees of freedom for error. If the 
series of experiments consists of a number of small Latin Squares, say, 
4 X 4 squares, we shall be on rather uncertain ground if we use the 
analysis given above with weights equal to r/s?;. If the individual ex- 
periment is of lattice or incomplete block type, a weighted analysis of 
treatment means may be used to test for place-treatment interactions, 
in which each treatment mean is assumed to have a variance equal to 
V4 of the average variance of a treatment difference (this is sometimes 
known as the "effective mean square"). If each experiment is of the 
split-plot type and both whole-plot and split-plot errors are homoge- 
neous over places, the combined analysis of variance will consist of two 
portions: one for whole plots and one for split plots. If the split-plot 
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factor is of the type discussed in Section 27.3, we shall have to use a 
similar device to test for the effects of the whole-plot factor. 


28.5 A VARIETY TRIAL AT A RANDOM SAMPLE OF PLACES 
FOR A NUMBER OF YEARS 


We shall consider the analysis of a trial on e varieties with r random- - 
ized blocks at each of a places in b years, and the model we shall use is 
the following: 


Wiki = B+ Pi + yi D + Ve (p) + Qo) + (yii 
+ rin + eyn (12) 


where 
j-i = 12,0, a 
jz12 b 
k=1,2, -pe 
T= l2 T 


The results at any one place in any one year are qual to 
[u + pi + yi Gel + We + (u)a + (yr) jn + (pyr) jel + rii eina 
which is analogous to the usual form for the single experiment of 
Ynn = u + ln + Um + enn 
We shall assume that 
E(pv)ix = E(yo)jx = E(pyo)x = 0 

the expectation being taken over any one subscript. As a consequence. 
the »,s measure the differences between varieties averaged over all 
places and years. We shall also assume that K 

EOD) = op EGO Y = 0°» 

EO = e m EV) = 0°, - 


E(pye)? ije = pyw E(py)* = py 
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and that the experiments are all subject to the same experimental error 
variance c?. Regardless of the distributions involved, we may make 
the analysis of variance given in Table 28.7. 


TABLE 28.7 ANALYSIS OF VARIANCE OF GROUP OF EXPERIMENTS 


Mean 
Due to af Square Expectation of Mean Square 
Pisos 4-1 F sie yyy + rb! ps N r + rhei 
Years b-1 Y a? + ro? pyy + rao? + reo! py race, 
Places X years (a — ) — 1) PY e? + ro yyy + reo) py 
rab 
Varieties e-1 Y a? + ra?pyv + rao?yn + rbo*p, + =A E(w-—)! 
Places X varieties - be 5 PV ne + rbo?po 
Years X varieties = 1) YV h d e 
Places X years X varieties (a — 1) — D(c — 1) PYV a? e re!pys 
Replications ab(r — 1) 
Error able — 1)(r — 1) E a 
Total aber — 1 


These expectations are easily checked by considering the mean square 
as a function of the 5% s. For example, PY is equal to 


7 O (a. — Ves T Ve t ye» 


If we may assume normal distributions for each of the random variables 
in the model, we can write down immediately several tests of hypotheses. 

Let us consider the hypothesis which may be of interest to the ex- 
perimenter. The effect of variety k at place i in year j is 


vk + (D) + (yo) + ( 


and the experimenter will be interested in the significance of combina- 

tions of the terms in this expression. He will certainly wish to test the 

hypothesis that the v;'s are equal, and, for that purpose, we may use 

a a test analogous to the test given in the previous section: namely, to 

compare the criterion V/(PV + YV — PYV) with the F distribution 
with (c — 1) and n degrees of freedom, where 
(PV + YV — PYV)? 


r 


(a — e — n* (b De yee 1)(b — De — 1) 


The experimenter may also be interested in the differences between va- 
rieties for the set of places actually used and for all possible years. In 
terms of the v,'s, (Pp) 's, and so on, these differences are given by the 
differences of 


va = n he 
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where Z' denotes summation over the sample of places, the other terms 
dropping out because we are considering all possible years. Insofar as 
we wish to talk about the set of places used, the terms (pv);z, where i 
takes the values for these places, are not random variables, because, 
with repetitions over the population of interest, we shall encounter the 
same variables each time. The test of the hypothesis that the v’;’s are 
constant may be obtained by noting that, if we had made an analysis 
of variance for this hypothesis, the quantity 


Efo'r na py 
e¢=1 
would appear in Table 28.7, instead of 
1 E(v4 — v)? 
= ops + —————— 
a e=1 
The expectation of the variety mean square would turn out to be 


rab 


a? + r + rac? yy + D(v', — v) 


e1 

To test the equality of the v'j's, we take the criterion V/YV and com- 
pare it with the F distribution with (c — 1) and (b — 1)(c — 1) degrees 
of freedom. The hypothesis under test can perhaps be described more 
clearly in the form: Are there differences between varieties for this set 
of places that are consistent over all years? 

We now make a list of the hypotheses that can be tested with a group 
of experiments of the type we have specified. It must be emphasized 
that by no means all of the hypotheses we shall mention are of practical 
interest, but our list will serve the purpose of indicating exactly what 
the possible test, criteria in fact test. The multiplicity of hypotheses 
that can be tested is a possible source of some confusion, which we hope 
to remove. Possible questions and appropriate tests are: 


1. Are there variety differences consistent over all places and years? 
The test criterion is given above. 

2. Are there variety differences consistent over all years with this set 
of places? The test criterion is V/YV. 

3. Are there variety differences consistent over all places with this 
set of years? The test criterion is V/PV. 

4. Do the varieties interact with places consistently over all years? 
The test criterion is PV/PYV. 
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5. Do the varieties interact with years consistently over all the places? 
The test criterion is YV/PYV. 

6. Is there an interaction of places, varieties, and years? The test 
criterion is PYV/E. 

7. Are there variety effects averaged over this set of places and this 
set of years? The test criterion is V/E. ~ 

8. Are there variety-place interactions for this set of years? The 
test criterion is PV/E. 

9. Are there varic*v-year interactions for this set of places? The 
test criterion is VV/E. 


All of the above tests are not necessarily of interest, and, in fact, if the 
set of places was actually chosen at random, there can be little use for 
a test on the population consisting of the set of places actually used. 
In general, the most apt condensation of the results is a statement of 
the variance components with estimated errors. It may be noted that 
the sums of squares that do not contain fixed variables are distributed 
independently as x?(expectation of mean square) with the appropriate 
degrees of freedom for x”. If a component of variance is estimated by 


1 
n (Sı — S2) 


where S, and S are observed mean squares with nı and na degrees of 
freedom, then the variance of the estimate is 


D 
where Z(S;) is the expectation of Sj. The variance of ; (S, — S3) may 
be estimated by 


2( 85 S’ ) ; ( S". E*(S;) 
ol earth ama uias a- ni 


In the same way that there are a number of tests of hypotheses that 
can be made, there are a number of estimates that can be considered, 
though not many of them are of interest. We can estimate a varietal 
difference for the set of places and years actually used, for the set of 
places and all years, for the set of places and for a random year, and so 
on. The point estimate of the difference will be the same for all the pos- 
sible cireumstances mentioned, but the variance of the estimate will be 


n, n3 
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different. The observed mean difference between two varieties, say, 1 


and 2, is 


1 1 1 1 
D= |n T M (p)a ty — (wa ＋ 5 (win t- x enu] 


1 1 1 1 
ix [s + a — (pv) ia + b — (yo) j2 + po 2y (pyv)ij2 + RI M «| 
(14) 


where X’ denotes summation over the sets of i, j actually used in the ex- 
periment. Suppose we wish to estimate the difference of variety 1 and 
variety 2 for the set of places used over all possible years, that is, we 
wish to estimate 


gE E + : 24 (| e E " 2 06e (15) 
then, E 


02 c? 02 j 
MC yv pyv 
E(D — 8) 20 n Qr: 5 (16) 


and the variance of D as an estimate of 6 is estimated by 2 E. Also, ` 


we may construct a confidence interval for 0 in the usual way. As a 
second example, suppose we wish to estimate the gain in yield ¢, which 
a randomly chosen farmer would obtain by using variety 1 rather than 
variety 2, say, in the next season. Then, 


o = [n + (p)a + Cran + (yo) — va + GD + (9) % + (pyr) il 
(17) 


where 7 denotes the farmer’s place, and j the next season which we as- 
sume to be a randomly chosen one. Then, i 


D-9) - LX! (pa -S E at (ma — Wat ote. (18) 
and : ; i 
1 
E(D—4? =2 [^C + 1) + 42 + 1) 
02 
HANE tm 


The estimates of the variance components can be entered in this ex- 
pression to give an estimated variance of D as an estimate of ¢. 
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Finally, we may consider the problem of allocation of experimental 
resources for a group of experiments to provide an estimate of varietal 
differences for all possible places in the population and all years. The 
variance of each varietal mean for comparisons over this population is 
Cove 6 4 60 ys 
ab a b 
In many investigations, it will be found that the best allocation consists 
of 2 replicates for each individual experiment to allow estimation of ex- 
perimental error, and as many places and years as possible. Some 
knowledge of costs is necessary before a solution can be obtained, par- 
ticularly as regards allocation between places and years. This formula 
is of some use in breeding programs, for example, in the selection of 
lines of corn for general distribution over an area. If we select the top 
p percent of a sample of V lines on the basis of their yields in a group of 
experiments with r randomized blocks at each of a places in each of b 
years, then the expected difference between the mean of all V lines and 
the mean of the selected p percent is 


Ko’, 
Oa Aran TUAE T 
gh Nr Spe PyE I 
" pz b m a t ab B b 


where o°, is the variance of the population of lines, and K is a function 
of p and V, which is known (or calculable) if the distribution of yields 
of lines is assumed to be normal (cf. Federer and Sprague ?). 


1 02 
"i (e? + 70% + rbo?,, + ra = d EE 


. 28.6 DIFFICULTIES IN THE ANALYSIS OF A GROUP OF 
EXPERIMENTS 


The difficulties that arise in practice can be listed by referring to the 
assumptions of the analyses given in the previous section. They are 
that the components of variance o°, %%, 7p», and %% may not be 
homogeneous. 

If the experimental error variances c? vary from experiment to ex- 
periment, but we have, for each experiment, an estimate of o°, say, s?;;, 
based on 15 or more degrees of freedom, we may test the hypothesis 
that % = 0 by a weighted analysis of the means for each place and 
year, using weights r/s?;. The test is analogous to the one we used for 
testing the hypothesis that , equals 0 for a single series of experi- 
ments. If all the other variance components are homogeneous, effects 
will be estimated from the variety-place-year means, and the variance 
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of each variety-place-year mean is c?,,, + r. If the experimental 
error variances are heterogeneous, but o”py» is intermediate between or 
greater than the quantities c?/r, an unweighted analysis of variety- 
place-year means may be used to test approximately for variety-place 
or variety-year interactions, and for average varietal effects. The tests 
will be exactly the same in terms of mean squares as those given for the 
complete analysis in Table 28.7. 

A frequent source of difficulty will be heterogeneity of the variance 
components c?,, and e. An examination of the variety means by 
place and year may suggest the separation of the (c — 1) degrees of 
freedom between varieties into sets which are homogeneous in these re- 
spects. A separate analysis would then be made for each set. The 
analysis for a set of (¢ — 1) degrees of freedom will be of the form shown 
in Table 28.8. 


TaBLIR 28.8 
Due to df Expectation of Mean Square 
Varietal comparisons t-1 o? + re! yy, + rden, + rbo*py + QU) 
Places X varieties ( 90 — 5 rene + rbi, 
Years X varieties = 1-1) e? + re pys + rael ys 
Places X years X varieties (a 0 -1)¢-1) e! + ro%pys 


rab 

The quantity () is equal to IX (sum of squares of true values), 
and is zero only if the comparisons of the vy's corresponding to the (f — 1) 
degrees of freedom are all zero, and positive otherwise. An example of 
this method of analysis is given by Yates and Cochran. A difficulty 
with this approach is that we may bias our conclusions considerably by 


choosing a method of analysis that seems reasonable in the light of the 
actual data. 
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CHAPTER 29 


Treatments Applied in Sequence 


In this chapter we shall discuss situations in which treatments are 
applied in sequence to the experimental unit. We shall be concerned 
primarily with the case in which we are interested in the effects of each 
treatment in the sequence, which are assumed to be independent of the 
previous treatment. Some designs for this situation are known as cross- 
over or switch-over designs. The most complex problem is that of the 
long-term experiment, in which it is desired to compare, for example, 
continuous treatments, or several crop rotations, or sequences of agro- 
nomie practices. We shall discuss long-term experiments only to the 
extent of defining some of the problems and giving the more simple de- 
vices of design. The main distinction between the switch-over design 
and the long-term experiment, is that, in the former case, we are inter- 
ested in the effects of the treatments making up the sequence, whereas, 
in the latter, the effect of the whole sequence is of interest. 


29.1 THE COMPARISON OF 3 TREATMENTS 


Consider the following pattern for testing 3 nutritional treatments on 
the milk yield of dairy cows in which the total experimental time of 3 
months is divided into 3 periods each of 1 month: 


Cow 
Period 1 2 3 
A. 4. 9 s 
XE XT 
IH e & 5 


The treatments are denoted by a, b, and c, and the whole pattern is a 
Latin square with periods as rows and cows as columns. We have noted 
that the Latin square design is effective in reducing the error of treat- 


ment comparisons by removing row and column effects. The above 
594 
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pattern is very suitable for the problem, because differences between 
cows and differences between periods will be large, relative to the mag- 
nitudes of treatment effects which would be regarded as important. If 
we select cows that are similar in breed, age, and other characteristics 
and that started their lactation at about the same date, we may expect 
the differences between periods to be relatively constant over the cows 
selected. The error variance of the experiment will be expected to be 
correspondingly smaller than with a design that does not utilize the 
stratification by cows and periods. The pattern we have given is a 
valid design for the comparison of the 3 treatments if the effects of 
treatments are additive and if we select a random 3 X 3 Latin square. 
We have noted that a single 3 X 3 Latin square design is inadequate, 
so that a number of repetitions will be necessary. If sets of 3 cows are 
used, with a random square for each set, and if the error variances are 
homogeneous between the sets, an analysis of variance of the form shown 
in Table 29.1 may be obtained. 


TABLE 29.1 STRUCTURE or ANALYSIS OF VARIANCE 


Due to df 
Sets r-1 
Cows within sets 2r 
Periods within sets 2r 
Treatments 2 
Treatments by sets 2(r — 1) 
Error within sets 2r 

"Total 9r—1 


The sum of squares for periods within each set must be isolated from 
the error, because we have a 3 X 3 Latin square for each set, and dif- 
ferences between periods within each set cannot have any effect on the 
estimates of the treatment effects or on the errors of the estimates. We 
may note in passing that, even if the periods are the same for the r sets 
of cows, and we are prepared to make the assumption that the period 
effects are the same in the r sets, we must not pool the sum of squares 
with 2(r — 1) degrees of freedom for periods by sets with the error, be- 
cause the periods by sets sum of squares would be zero. It is easily 
verified, given the previous results on the characteristics of randomiza- 
tion procedures, that the expectation of tlie treatment mean square is 
equal to the expectation of the error mean square in the above analysis 
of variance under the null hypothesis and that the usual formulas hold 
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for the variance of an estimated comparison. We make this remark 
because, on the basis of an infinite model, with constant period effects, 
the expected value of the mean square for periods by sets is equal to o°, 
which is the expectation of the error mean square above. This is an 
example of how the use of an infinite model can lead us astray. We 
may pool the sums of squares for treatments by repetitions and for 
error within repetitions only if we are prepared to assume that the treat- 
ment effects are the same in the r repetitions. If we do not pool these 
2 components, the criterion (treatment mean square/error within repe- 
titions mean square) tests the effects of treatments averaged over the 
sets of cows used. 

So far we have not made any deviation from the normal use of the 
Latin square. The crucial condition for the design to be valid for the 
purpose at hand is that the treatments be additive in their effects for 
each combination of cow and period. Thus, if the basic yield of cow j 
in period i is z;; the yield under treatment k, say, %, is equal to 
Tij + t. We regard the data for one Latin square as having arisen 
from the model À 

Yije = B + Ppi + 6 + tk + ey (1) 
where 


k = 1 for a, 2 for b, 3 forc 

p = the effect common to all cow-period combinations 
Pi = the effect common to all cows for period i 

c; = the effect common to all periods for cow j 


ly = the effect common to all cow-period combinations 
that receive treatment k 
and 


eij = the error 


The practical obstacle we encounter with this design is that there may 
be residual effects, and the design we have used is not a valid one in 
this case. It is essential to use every possible device to ensure that there 
are no residual effects, the simplest one being to allow an interval be- 
tween each experimental period during which we hope that residual 
effects of the treatments will be used up. However, even if the inter- 
vals chosen are long, the assumption that residual effects have been 
eliminated is a somewhat hazardous one, for the physiology of the cow 
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is such that a whole lactation is, in a sense, a unit of biological activity. 
The question reduces to a consideration of the treatments in relation to 
the physiology of the animal; if, for instance, the treatments were dif- 
ferent vitamins or amounts of vitamins, an interval of a certain length 
will probably be sufficient, whereas, if the treatments are number of 
times per day that access to water is allowed, the interval should prob- 
ably be of a different length. : 

In view of these difficulties we may consider the design we have given 
from the point of view of residual effects. There are two essentially 
different Latin squares which we may obtain by randomization (Table 
29.2). 


TABLE 29.2 - 

Square I Square II 
Cow Cow 
Period 1 2 3 Period 1 2 8 
I abe I abe 
II bea II cab 
III c a b III bea 


We allow ourselves to obtain squares of type I or of type II, with a 
probability of V4 for each. It may be noted, that in square I, treatment 
b always follows treatment a unless it is the first, treatment c always 
follows b, and treatment a always follows c. In square II, on the other 
hand, treatment b follows treatment c, treatment c follows treatment a, 
and treatment a follows treatment b. Our immediate reaction is that 
it would be wise to insist on an equal representation of the two ty pes of 
square, for it would then be the case that any treatment follows the 
other 2 treatments with equal frequency. We find frequently that a 
design that looks balanced is better than one that is unbalanced, and 
so the modification is worth considering. 

With this modification our randomization procedure will be to assign 
a square of type I or type II at random to r of the sets, with the stipula- 
tion that each type of square is represented equally frequently, and then 
randomize the allocation of sequences of treatments to the cows. In 


67 possible allocations of sequences 
(2 

2/ M 
The interesting point is that we do not allow 
t, and might therefore suspect 


this way, we would generate 


of treatments to cows. 
independent Latin squares from set to se 
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that the design is not valid. If we specify that a square is to be of type 
I, we can obtain any one of the 6 squares shown in Table 29.3. 


TABLE 29.3 


For squares II, Is, and Is, the partition of the 9 cells of the square 
into 3 groups of those cells is the same, and both the treatment sum of 
squares and error sum of squares will be the same for all 3 squares, while, 
for squares Iz, I4, and Is, the treatment sum of squares will be the same 
and equal the error sum of squares for squares II, Is, and Is, and the 
error sum of squares will be the same for all 3 squares and equal to the 
treatment sum of squares for squares II, Is, and I. Furthermore, the 
quantities 35 of Chapter 10 have the distributional properties necessary 
for a Latin square analysis. The analysis of variance given in Table 
29.1 is therefore valid for this restricted randomization also. A practi- 
cal example of this design is given by Cochran, Autrey, and Cannon. 
With r small, it might well be advisable to test the hypothesis that treat- 
ments have no effect by the randomization test. 

We now consider a further modification of the basic design. If we 
are able to perform only 4 repetitions, the number of degrees of freedom 
for error is 8, or 14 if we can assume the treatment effects to be constant 
over the 4 repetitions. If we assume that the periods are identical for 
the 4 repetitions, it might be reasonable under some circumstances to 
. consider the set of 12 cows as a whole, and to assign the 6 possible se- 
quences at random to the 12 cows, with the stipulation that each se- 
quence is represented twice. If this were a valid design we would iso- 
late 2 degrees of freedom for periods, 11 for cows, and 2 for treatments, 
leaving 20 degrees of freedom for error. To examine this design, we as- 
sume additivity of treatment effects as before, so that the yield from 
treatment k in period i from cow j is u equal to zi; + t. The model 
may be written in the form 


Vik = 2.. + (. — 2.) + G2. ) + te + (By — t; — zyj T ..) 
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where the terms in order are the mean, the period effect, the cow effect, 
the treatment effect, and the error, and we may write this in the form 
Yije = B + Pi + ejt d eij 


It is possible that we can look at this design and state its properties. A 
rigorous examination is, however, the only reliable method of doing so, 
and is also of general interest. We shall number the sequences by s 
that can take the values 1 to 6, and are given by 


Period 1 2 8 4 5 6 
I a bc a.b. c 
Il bcaea b 
III e a b ö e 4 


The experimental design is defined by the function ôs; which is equal 
to 1 if sequence s (equals 1, ***; 6) is assigned to cow j (equals 1, 2, 
. . 12), and zero otherwise. The function ôs; has the properties, that 


à, =1 with probability 4% 
— 0 with probability 56 
if 
à, 1 then 67; =0 for alls“ = s 


and s 
ôs =1 with probability {1 


= 0 with probability 19411 70 
%% =1 with probability 211 
=0 with probability 911 


This specification of the distribution of the à,7's is sufficient for our pur- 
pose. Treatment comparisons are subject, only to the errors ei, for we 
have ensured that each treatment occurs in each period and with each 
cow. The treatment total for treatment a is equal to 


124 + 12h + X; dryers + DL dae + — ôsjeaj + Tb 
j 7 7 
+ E dien f. È bast (2) 
j 


since, if sequence 1 is allocated to cow j, the contribution to the treat- 
ment total is ei, and so on. 
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It is easily verified that, if A, B, and C are the treatment totals, then 


EA-E(AP)- 34 L 


EIA — ECA) — E(B)] 


Metro) m. mn] 
12 36 


ll 

I 
Es 
M 
$ 


6 (t + te + ts)? 
TEC Rue ene oe - 6] 


By definition, a cow total is equal to 3u + 3c; + (ti + t + t3), and 
differences between cow totals therefore measure cow effects only. Like- 
wise, a period total is equal to 12 + 12p; + 4(4 + te + t3), so that 
period differences contain none of the terms eij- 

If we make the analysis of variance with structure 


Due to df 
Cows 11 
Periods 2 
Treatments 2 
Error 20 

Total 35 


the expectation of the error sum of squares is Ze?;; minus 866 Lei, or 
$966Ze*;. The expectation of the treatment mean square in the ab- 
sence of treatment effects is therefore equal to the expectation of the 
error mean square. If the true error mean square is c?, equal to 366 De , 
the variance of any comparison is obtained by regarding the treatment 
means as having a variance of c?/ 12, and applying the usual rules. For 
example, 


AL BRYT 724 24 24 1/1 
(1 KC azout ue) - one) 


12 12 2 
1/3 oF (gt gt 
=- Š zes) - — 
365 4)" 6 "13+ 9 


29.2 THE CASE OF 4 TREATMENTS 


The extension of the designs given earlier to the case of 4 treatments 
is straightforward. The design that has been suggested for this case 
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(Cochran ?) is based on the three 4 X 4 squares in Table 29.4, which, 
when superimposed, give a completely orthogonal square. 


TABLE 29.4 


Square I Square II | Square III 
Period 


1 2 3 45 6 7 89 10 11 12 


If we have 3 sets of 4 cows and we assign one of the 3 squares to each 
set at random, and then assign columns at random to cows within each 
set, we have a design in which each treatment is preceded by the other 
treatments with equal frequency. 

To examine this design, we may denote the 12 sequences of treatments 
above by the numbers 1 to 12 and utilize the function ôs; which equals 
unity if sequence s is allocated to cow j. For each square we would like 
to make the following partition in the-analysis of variance: 


Due to 
Cows 
Periods 
Treatments 
Error 


* ee c ce S 


Total 


We shall consider the analysis of the first square and the first 4 se- 
quences of treatments. The treatments will be assumed to be additive, 
so that, if the yield under a uniform treatment of cow j in period i is 
Zij, the yield under treatment k is yi equal to % +t. We have, 
therefore, the identity 


Yijk = . . + (ti —2.)4d-(z;— 2.) ＋ t& ＋ (Zij — zi — 2 ＋ ..) 
= p bei the + ej (3) 
A period total is equal to 4 + 4p; + Zt, so that the period sum of 
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squares contains no treatment effects or errors, and similarly for the 
cow totals. The treatment totals are given by 


A = 4u + 4t + Döner + D ôzjeaj + DO Paesi + 22 Deas 
j j j j 


B = 4u + At + D je + D bini + D dag + Tb. bes, 
i 7 j 7 
(4) 
C= 4u + Atg + 35 ônjes; + L bz, + Do ajeri + Do dez 
j j j j 
D = 4u + At + T die + D faits + T basen; + L bier, 
D j j j 
where summation on j is from 1 to 4, over the 4 cows of the set. 
„The quantities ô; have the usual properties, namely: 
5. = l1 with probability 14 
=0 with probability 24 


if 
8.1 then 545,20 7 
and 
65; 0 8 #8 
and 


öv; — D with probability 14, „ #3, J. #7 


The expectation of a treatment total is 4u + 40, so that the design gives 
unbiased estimates of treatment differences. The expectation of the 


square of a treatment total, apart from mean and treatment effect, is, 
for example, 


2 
E(A?) = E [= (01615 + 60;€25 + 03563; + e) | 
7 


and, by utilizing the properties of the 5,;, we find that 
(A?) = tE eatis Ley = Des 
7 ij ij 
The expectation of T the grand total contains no errors, so that the ex- 
pectation of the treatment sum of squares is 
? (= B* 5 4 


— + —$—4+— =) si Ta, 
1 i 26 
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The expectation of the total sum of squares apart from treatment effects 
is 25 e*,;, so that the expectation of the error sum of squares is, by sub- 


y 
traction, equal to 842 > €^. The expectation of the treatment mean 
v 
square in the absence of treatment effects is 36 L eg which is also equal 
7 


to the expectation of the error mean square. The design is therefore 
unbiased in the sense in which the term is used in experimental design. 
This is in itself a curious fact, because we have not allowed the full ran- 
domization that we usually require with a Latin square. It turns out 
that the 24 possible randomizations will give equal sums of squares for 
treatments in sets of 4, there being only 6 different possible values. In 
a randomization test of the effects of the treatments, therefore, the mini- 
mum level of significance for an over-all test of treatment effects is 16. 
All the results we have obtained above hold for the other 2 squares also. 
The minimum level of significance we can have for the 3 squares jointly 
is 416. 

We now consider treatment comparisons and, as an example, take 
A — B for the first square, 


(A — B) = 4(l — te) + Löten — e) + 22 ôz;(e2; — ej) 
j 7 : ; 
+ 3865; — €) + 22 de — en) (5) 
j j 
The expectation of the square of the difference is 
E(A — By = 16(4 — t)? 
T4 22 (€ + 6; + 63; + 0745 2e — 2e) (6) 
j í 
For the second square, numbering the cows from 1 to 4 again, 
E(A — B) = 160 — t)? 
HED (P + aj + aj H eaj — Reres — 2eajeaj) (7) 
7 
and, for the third square, 
E(A — B)? = 160 — ts)” 
+E (83 + eaj t ea + Paj — 2ejey — 2ezjea;) (8) 
E ; 
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We note, therefore, that the error of this difference depends on the square 
used and is not directly determinable from the expectation of the error 
mean square. We have, however, assigned the squares at random to 
the 3 sets of 4 cows, so that the above errors occur each with a frequency 
of 14 for any one set of cows. The expectation of the squares error of 
(A — B) from each set of cows is 

t 


$ 22 85 — L Genes, + 2esjesj + Nee + 2ezjeaj 
7 7 


+ 26563; + 22563) 
which equals 


8 22685 — FD Ulery Tea, + es + e)? — (eh; + e725 + 63; + ea) 
9 j 


or (9) 
$2 es 
17 


which is equal to 8(expectation of error mean square). It may further 
be verified that all treatment comparisons are estimated by the corre- 
sponding comparisons of treatment means, with error calculated in the 
usual way in terms of o, the error variance. 

'The analysis of variance of the design will have the structure: 


Due to df 
Periods within sets 9 
Cows 11 
Treatments 3 
Treatments by sets 6 
Error 18 

Total 47 


\ 
in which the terms are calculated in the usual way. In concluding the 
discussion of this design, it may be noted that the randomization of the 
allocation of squares to sets and sequences to cows is essential (or some 
other randomization scheme which generates the same population of 
possible patterns). It is also interesting to note that we may use any 
number of sets, providing that we allot each of the 3 squares to each set 
with a probability of 44. From the point of view of estimation, it is 
not at all essential that the 3 possible squares be represented equally 
frequently, but it is essential that, in the population of possible ran- 
domizations for each set of cows, the 3 squares or squares derived from 
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each by randomization of columns occur equally frequently. In other 
words, we can make reliable statements about the true treatment effects 
for the whole set of cows, if we take observations in this way. 


29.3 RESIDUAL EFFECTS 


We have seen that an essential part of the designs we have discussed 
in the two previous sections is the assumption that residual effects do 
not exist. In this section, we shall examine the effects of the presence 
of residual effects on interpretations made when there are assumed to 
be none. It will be of interest to note whether the balancing as regards 
preceding treatments serves any purpose at all. 

We shall consider the design for 3 treatments with 2 squares, the one 
having the order of treatments opposite from the other, and shall as- 
sume that the true yields bear the relationships to each other shown in 
Table 29.5. 


Taste 29.5 
Sequence 
Period 
1 2 3 1 5 6 
T b c a b c 


II b Ta! e T' arc! e Ta aT bre 
III [eb late ba! b Te! |a 


If the analysis derived for the case when there are no residual effects 
is used, the expectation of the mean square for treatments within sets 
with 4 degrees of freedom is 

3 a ＋ b 4- c 
eee eh -er 
2 3 
(a’ Er bv’ 2 =| 
3 
+ glad“ + c' — 2a") + b(c' + a^ — 2b’) + c(a' +b! — 2c’)] 
and of the error mean square within sets is 
(a’ E b! E 
3 


"n ; |o? F b"? + c?) E. 


A+ iat tute? — 
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The expectation of the sum of squares for treatment effects averaged 
over the 2 sets is likewise a complex expression. There does not appear 
to be any way of estimating the direct effects if residual effects are pres- 
ent. The sole advantage of the balancing is that a comparison of ob- 
served treatment totals is a comparison of (6 X direct effect — 2 x 
residual effect), so that we still have a comparison of the effects of the 
treatments, and we are not measuring a linear combination of the direct 
effects of one treatment and residual effects of others. 

We make note of this, because we may modify the model we used in 
the absence of residual effects 


Yije = B+ pice tt ej 


simply by adding a further term, say, r; which denotes the additive 
effect on % if treatment k is preceded by treatment /, giving the model 


Vk = n Pit ei b + rit eij 


If, as we can with most experimental designs, and indeed for the pres- 
ent design with no residual effects, we assume as a device that the e;;'s 
are normally and independently distributed with mean zero and vari- 
ance c?, we can derive least squares estimates of the /,'s and rs. This 
procedure is subject essentially to the same difficulties as those we men- 
tioned in Chapter 8 for the covariance technique. The reader may 
verify if he desires that this procedure does not lead to estimates that 
have a variance which may be estimated, in the sense that we estimate 
the variance of treatment comparisons in the ordinary randomized block 
or Latin square experiment. The difficulty about the assumption of 
normality of the errors is that we cannot specify accurately the popula- 
tion we are discussing. The procedure we follow, in the absence of 
residual effects, leads to statements of treatment effects on the cows ac- 
tually used, and only on those cows. If we broaden the experiment by 
drawing sets of cows from a population by a random device, we can make 
statements about that population on the lines of Chapter 28. 

The first problem when residual effects are known to: be present is 
one of definition of what we mean by an assessment of the effect of the 
treatment. In the case of the hypothetical cow experiments discussed 
earlier in the chapter, we can regard the effect of a treatment as being 
made up of its direct effect in the period of application, plus the first- 
period residual effect, plus the second-period residual effect, and so on, 
weighted in some desired way. For example, if the lactation period 
consists of the 3 periods, and the treatment is applied continuously, we 
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might expect to obtain 3 times the direct effect plus twice the first-period 
residual effect plus the second-period residual effect. Even if we could 
devise a design that would estimate direct effects, first-period residual 
effects, and second-period residual effects, however, this would be a 
most unsatisfactory way of estimating the effect of the treatment ap- 
plied over the whole period, for we assume additivity of the effect of a 
treatment and its residual effect. A treatment applied for one period 
might well have a considerable residual effect if another treatment is 
' applied in the second period, and no residual effect, when the treatment 
in the second period is the same. It does not seem possible to avoid the 
conclusion that, if we wish to assess effects of treatments applied for a 
certain period, we must apply the treatments for the whole of that 
period. Having done so and kept a record of the response (i.e., yield). 
at regular intervals, we would then examine the records and abstract 
any measure we desire from the whole time-yield relationship. A basic 
assumption in the switch-over design is that the effect of a treatment is 
the same in all the periods in which it may be applied. This may per- 
haps be true of some characteristics of the animal, such as vitamin con- 
tent of the blood, but is very unlikely to be true, for example, in the 
case of yield of milk. On all scores, therefore, the use of the switch-over 
design for the type of problem considered here is questionable. The 
utility of the switch-over design, or, in fact, of any design that involves 
different treatments on the same experimental unit, is limited because 
of the necessity of constant treatment effects and zero residual effects. 

There are no new problems of design, though there may be difficulties 
of analysis when the treatments are applied-for the whole period of 
interest. 


29.4 LONG-TERM AGRICULTURAL EXPERIMENTS 


The most extensive discussion of this subject is that of Cochran.” 
The most important types of problem are (1) the comparison of differ- 
ent rotations, for example, a 2-year rotation of crops, say, corn and oats 
repeated indefinitely, and a 3-year rotation of crops, say, corn, corn and 
oats repeated indefinitely, and (2) the comparison of agronomic prac- 
tices on a fixed rotation. Combinations of these two types of problem 
are of frequent occurrence. 

The basic point in the design of these experiments is that we can sam- 
ple only the number of years that the experiment is performed, and, in 
general, experience indicates that, in matters of crop yield or the effec- 
tiveness of agronomic practices, the year-to-year variations in the ef- 
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fects are considerable and often larger in magnitude than plot-to-plot 
variations within a year. For this reason, it is essential that every crop 
of the rotations under comparison, or every phase of the agronomic 
practices, be represented by a plot every year. 'Thus, if we are compar- 
ing 2 rotations CO CO --- and COCCO, it is necessary to 
have multiples of a set of 5 plots with the treatments shown in Table 
29.6. 


TABLE 29.6 

Plot 
Year 1 2 3 4 6 
SG "Cae 
2 0 000 0 
3 CO O 
4 occco 
5 COCOC 
6 O 0 O0 


In the same way, if some of the agronomie treatments are to be ap- 
plied at fixed intervals, all the possible phases of the application of 
treatments must be represented in each year. In other words, for any 
year there must be a plot receiving the treatment in that year, a plot 
that received the treatment in the previous year, a plot that received 
the treatment 2 years previously, and so on. These considerations come 
directly from the fact that we may expect years to have large effects. 
In the same way, we can say that replication other than by phase in 
any one year is not of great importance, and frequently 2 replicates will 
be sufficient. 

Cochran? and Crowther and Cochran“ give examples of the various 
types of design and their analyses, and the interested reader may refer 
to these papers. We shall merely consider some of the difficulties that 
are inherent in the structure of the data which will be obtained. 

After a long-term experiment has been performed for a long period 
of time, say, 25 years, we are presented with the history of each plot in 
terms of treatments and yields. The first problem is to decide how we 
wish to characterize the sequence of yields, From some points of view, 
an expression of trends in terms of orthogonal polynomials, by the linear 
trend, the quadratic trend, the cubic trend, and so on, is suitable, and 
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this was the method used first by Fisher,! by Cochran,? and by Crowther 
and Cochran; This procedure is not particularly satisfactory and has 
not been successful in the somewhat similar problems of the analysis of 
economic time series. It does not give a representation of the yield- 
time relationship which can be extrapolated to succeeding years. One 
of the important problems in assessing different crop rotations is to de- 
termine the limiting yields: that is, the yields of the crops of the rota- 
tion after the rotation has experienced, say, 20 or 30 cycles. For this 
purpose orthogonal polynomials are not satisfactory. The linear trend 
may be a reasonable representation of the change in yields over a rela- 
tively short period only at the beginning of the cycles of the rotation or 
after the cycles are producing little further changes. A further reason 
that militates against the use of orthogonal polynomials is that it is 
difficult to think of a mechanism which would result in a polynomial 
relationship of yields to time. 

A second problem in the analysis of yields for each plot is that there 
may. be correlation among the errors from year to year. The situation 
is entirely different from the 1-year agricultural experiment, for which 
the main errors are“the plot errors and randomization is designed to es- 
timate their effects. We may imagine that the true relationship of the 
yields of a crop of the rotation to time for a plot is given by a function, 
and that the observed values deviate from this function by an error. 
These errors will tend to be correlated, and some data give a strong in- 
dication of such an effect. An approach to the analysis of simple long- 
term experiments from this point of view is under way. Another diffi- 
culty which is certain to arise is the one discussed in the earlier parts 
of this chapter: namely, that simple analyses of variance involving years 
are useful only if we can assume that there are no residual effects of 
crops or treatments as the case may be. The existence of residual ef- 
fects of crops and agronomic treatments is usually the main reason for 


performing long-term experiments. 
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Taste I Variance Ratio 


10% Points of e? 


Lower 10% points are found by interchange of n; and nq; i.e., nı must always correspond with the 


greater mean square, 


for Biological, Agricultural, 


by permission of the authors and publishers. 


Table I is reprinted from Table V of Fisher and Yates: Statistical Tables 


and Medical Research, Oliver and Boyd Ltd., Edinburgh, 
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Taste I Variance Ratio (Continued) 
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Tase II TABLE or E20 AND THE CoRRESPONDING VALUES OF Prr 


A-1 
$ 
h Et 
1 1.5 2 2.5 3 4 5 6 rd 8 

2 0.980 | 0.970 | 0.947 | 0.914 | 0.874 | 0.828 | 0.720 | 0.602 | 0.484 0.373 | 0.277 
4 0.841 | 0.949 | 0.885 | 0.784 | 0.651 | 0.501 | 0.233 | 0.077 0.018 | 0.003 
6 0.696 | 0.934 | 0.839 | 0.687 | 0.498 | 0.312 | 0.076 | 0.010 0.001 

7 0.636 | 6.928 | 0.822 | 0.652 | 0.447 | 0.258 | 0.049 | 0.006 

8 | 0.585 | 0.924 | 0.808 | 0.624 | 0.409 | 0.221 | 0.034 | 0.002 

9 | 0.540 | 0.920 | 0.796 | 0.601 | 0.379 | 0.193 | 0.025 | 0.001 

10 | 0.501 | 0.916 | 0.786 | 0.582 | 0.355 | 0.172 | 0.019 | 0.001 

11 0.467 | 0.913 | 0.777 | 0.567 | 0.336 | 0.156 | 0.015 

12 0.437 | 0.911 | 0.770 | 0.553 | 0.320 | 0.144 | 0.012 

13 0.411 | 0.909 | 0.763 | 0.542 | 0.307 | 0,133 | 0.010 

14 0.388 | 0.907 | 0.758 | 0.532 | 0.296 | 0.125 0.009 

15 0.367 | 0.905 | 0.753 | 0.523 | 0.286 | 0.118 0.008 

16 0.348 | 0.904 | 0.749 | 0.516 | 0.278 | 0.112 0.007 

17 0.331 | 0.902 | 0.745 | 0.509 | 0.271 | 0.107 0.006 

18 | 0.315 | 0.991 | 0.741 | 0.503 | 0.264 0.103 | 0.006 

19 0.301 | 0.900 | 0.738 | 0.498 | 0.259 | 0.099 0.005 E 
20 0.288 | 0.899 | 0.735 | 0.493 | 0.254 0.096 | 0.005 

21 0.276 | 0.898 | 0.732 | 0.488 | 0.249 0.093 | 0.004 

22 0.265 | 0.897 | 0.730 | 0.484 | 0.245 0.090 | 0.004 

23 0.255 | 0,896 | 0.728 | 0.481 | 0.241 0.088 | 0.004 

24 0.246 | 0.896 | 0.726 | 0.477 | 0.238 | 0.086 0.004 

25 0.237 | 0.895 | 0.724 | 0.474 0.235 | 0.084 | 0.004 

26 0.229 | 0.894 | 0.722 | 0.471 | 0.232 0.082 | 0.003 

27 0.221 | 0.894 | 0.720 | 0.469 | 0.229 0.081 | 0.003 

28 0.214 | 0.893 | 0.718 | 0.466 | 0.227 0.079 | 0.003 

29 0.212 | 0.893 | 0.717 | 0.464 0.225 | 0.078 | 0.003 

30 0.201 | 0.892 | 0.716 | 0.462 0.223 | 0.077 | 0.003 

60 0.106 | 0.885 | 0.696 | 0.430 0.194 | 0.061 | 0.002 

* 0.877 | 0.675 | 0.400 | 0.169 | 0.048 0.001 


! ..... N GEE 
Table II is taken from Statistical Research Memoirs, Vol. II, by kind permission of Professor E. 8. 
Pearson. 
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Taste II Taste or Ero o AND THE CORRESPONDING VALUES or. Pri (Continued) 


4-2 

fo | Boo 

1 1.5 3 4 5 7 8 

2 0.990 | 0.975 | 0.957 0.865 | 0.779 | 0.680 0.475 | 0.379 
4 0.900 | 0.957 | 0.901 0.540 | 0.266 | 0.095 0.004 | 0.001 
6 0.785 | 0.941 | 0.850 0.305 | 0.068 | 0.007 
7 0.732 | 0,934 | 0.828 0.235 | 0.035 | 0.004 
8 0,684 | 0.929 | 0.809 0.187 | 0.021 | 0.001 
9 0.641 | 0.924 | 0.793 0.152 | 0.013 

10 0.602 | 0.920 | 0.779 0.127 | 0 008 

11 0.567 | 0.916 | 0.767 0.108 | 0.006 

12 0.536 | 0.912 | 0.756 0.093 | 0.005 

13 0.508 | 0.909 | 0,746 0.082 

14 0.482 | 0.907 | 0.738 0.074 

15 0.459 | 0.904 | 0.730 0.066 

16 0.438 | 0.902 | 0.723 0.060 

17 0.418 | 0.900 | 0.717 0.055 

18 0.401 | 0.898 | 0.711 0.051 

19 0.384 | 0.896 | 0.706 0.048 

20 0.369 | 0.895 | 0.701 0,045 

21 0.355 | 0.894 | 0.697 0.042 

22 0.342 | 0.893 | 0.693 0.040 

23 0.330 | 0.891 | 0.690 0.038 

24 0.319 | 0,890 | 0.686 0.036 

25 | 0,308 | 0.889 | 0.683 0.035 

26 0.298 | 0.888 | 0.680 0.034 

27 0.280 | 0.887 | 0.678 0.032 

28 0.280 | 0,886 | 0.675 0.031 

29 0.272 | 0.886 | 0.672 0.030 

30 0.264 | 0.885 | 0,670 0.029 

60 0.142 | 0.873 | 0,637 0.019 

LJ 0.860 | 0.601 0,011 
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Taste II TABLE OF E^yo: AND THE CORRESPONDING Vauves or Py (Continued) 


h=3 
$ 
7 SS — 
h Ee. oi 
1 1.5 2 2.5 3 4 5 6 7 8 
2 0.993 | 0.977 | 0.961 | 0.939 0.911 | 0.878 | 0.800 | 0.709 0.612 | 0.515 | 0.421 
4 0.926 | 0.959 | 0.907 | 0.818 0.695 | 0.552 | 0.276 | 0.100 0.026 | 0.005 | 0.001 
6 | 0.830 | 0.943 | 0.850 | 0.691 | 0.486 0.290 | 0.059 | 0.006 
7 0.784 | 0.936 | 0.825 | 0.636 0.408 | 0.210 | 0.025 | 0.002 
8 0.740 | 0.929 | 0.803 | 0.590 0.347 | 0.158 | 0.014 
9 0.700 | 0.923 | 0.783 | 0.550 0.299 | 0.120 | 0.008 
10 0.663 | 0.918 | 0.765 | 0.517 0.261 | 0.094 | 0.004 
11 0.629 | 0.913 | 0.749 | 0.487 0.231 | 0.075 | 0.002 
12 0.598 | 0.909 | 0.735 | 0.463 0.206 | 0.062 | 0.001 
13 0.570 | 0.906 | 0.723 | 0.441 0.186 | 0.051 | 0.001 
14 0.544 | 0.902 | 0.711 | 0.422 0.170 | 0.044 | 0.001 
15 0.520 | 0.899 | 0.701 | 0.406 0.156 | 0.038 | 0.001 
16 0.498 | 0.896 | 0.692 | 0.391 0.145 | 0.033 
17 0.478 | 0.893 | 0.683 0.378 | 0.135 | 0.029 
18 0.459 | 0.891 | 0.676 | 0.367 0.126 | 0.026 
19 0.442 | 0.889 | 0.669 0.356 | 0.119 | 0.023 
20 0.426 | 0.887 | 0.662 | 0.347 0.112 | 0.021 
21 0.410 | 0.885 | 0.656 0.339 | 0.107 | 0.019 
22 0.396 | 0.883 | 0.651 0.331 | 0.102 | 0.017 
23 | 0.383 | 0.881 | 0.646 0.324 | 0.098 | 0.016 
24 0.371 | 0.880 | 0.641 0.318 | 0.094 | 0.015 
25 0.359 | 0.879 | 0.637 0.312 | 0.090 | 0.014 
26 0.349 | 0.877 | 0.633 0.307 | 0.087 | 0.013 
27 0.338 | 0.876 | 0.629 0.302 | 0.084 | 0.012 
28 0.329 | 0.875 | 0.625 0.297 | 0.081 | 0.012 
29 |0.319 | 0.874 | 0.622 0.293 | 0.079 | 0.011 
30 0.311 | 0.872 | 0.619 0.289 | 0.077 | 0.011 
60 | 0.171 | 0.856 | 0.571 0.233 | 0.050 | 0.005 
— 0.836 | 0.519 | 0.182 0.030 | 0.002 
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TasLE II TABLE or E% 01 AND THE CORRESPONDING VALUES OF Pn (Continued) 
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Taste II TABLE or ETO AND THE CORRESPONDING VALUES OF Pit (Continued) 
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Taste II TABLE or Eo AND THE CORRESPONDING VALUES OF Pry (Continued) 
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Tase II TABLE or E%,91 AND THE CORRESPONDING VALUES OF Py (Continued) 


4-8 


æ | 38 
| co 
ca 
WEE 
cc 
[-1 
e | 38 
ec 
111!!! a ̃ ͤ db— . 
co 
838 
888 
II...... . T—T—̃— L 
e 
.| 88888 
occoo 
* — —M————Ó— — a — náá— —— ——— — 
2222 io + — 2 2 
» | EESSESSSS ESSE ESSE 
códdoodoocodoccococooccc 
2 22 2 wae N 8 8 2 2 222 2 1 c 
2 BESSRSPIBEESEBBBSEISESEEEEES 
cccddoddoodccodcdococcoooccoocoooococo 
© ane ef — 2 2 - L-] on = + 
.| S8SBBISERRRRRESESSSRRRESBEBEE 
SSSSSSSSSSSSSS8SSSSSSS SSS SSS 
cC T LA e — © — I] e wu 
MEFTFITEEFHEEEEELEEHLHLELLETEE 
codododdddcocóoccoocooooococcco e 


TTITTITERREEEEEEEELEEEEEEEL EET: 


Gocddococóocoocoócocoocooocooocooocooc 


£ 


„ 5 gg 22S SAN ANN SSSR 888 


TABLES 621 


Tasie III TABLE or Eso. os AND THE CORRESPONDING VALUES oF Prr 


$ " 

fe | Evo eee casa, nar CRATES 11 ˙ 
1 1.5 2 3 4 5 6 7 8 

2 0.903 | 0.862 | 0.763 | 0.643 0.395 | 0.200 | 0.083 | 0.028 0.008 | 0.002 

4 0.658 | 0.805 | 0.631 | 0.428 0.120 | 0.016 | 0.001 

6 0.500 | 0.777 | 0.570 | 0.348 0.061 | 0.004 

7 0.444 0.768 0.552 | 0.319 0.050 | 0.003 

8 0.399 | 0.761 | 0.537 | 0.302 0.041 | 0.002 

9 0.362 | 0.756 | 0.526 | 0.288 0.036 | 0.001 

10 0.332 | 0.751 | 0.517 | 0.278 0.032 | 0.001 

11 0.306 | 0.747 | 0.510 | 0.269 0.029 | 0.001 

12 0.284 | 0.744 | 0.504 | 0.262 0.027 | 0.001 

13 0.264 | 0.741 | 0.499 | 0.256 0.096 | 0.025 | 0.001 

14 0.247 | 0.739 | 0.494 | 0.251 0.093 | 0.024 | 0.001 t 

15 0.232 | 0.787 | 0.490 | 0.247 0.090 | 0.023 

16 0,219 | 0.735 | 0.487 0.243 | 0.087 | 0.022 

17 0.207 | 0.734 | 0.484 | 0.240 0.085 | 0.021 

18 0.197 | 0.732 | 0.481 0.237 | 0.084 | 0.020 

19 0.187 | 0.731 | 0.479 0.235 | 0.082 | 0.020 

20 0.179 | 0.730 | 0.477 0.233 | 0.081 | 0.019 

21 0.171 | 0.729 | 0.475 0.231 | 0.079 | 0.019 

22 0.164 | 0.728 | 0.473 0.229 | 0.078 | 0.018 

23 0.157 | 0.727 | 0.471 0.227 | 0.077 0.018 

24 0.151 | 0.726 | 0,470 0.226 | 0.076 0.018 

25 0.145 | 0.725 | 0.468 0.224 | 0.075 | 0.017 

20 0.140 | 0,725 | 0.467 0.223 | 0.075 | 0.017 

27 0.135 | 0.724 | 0.466 | 0.222 0.074 | 0.017 - 

28 0.130 | 0.723 | 0.465 0.221 | 0.073 | 0.017 d 

29 0.126 | 0.723 | 0.464 0.220 | 0.073 | 0.017 

30 0.122 | 0.722 | 0.463 0.219 | 0,072 0.016 

60 0.063 | 0.715 | 0.450 | 0.205 0.065 | 0.014 

* 0.707 | 0.437 | 0.193 0.058 | 0.011 


Table III is taken from Statistical 
Pearson. 


Research. Memoirs, Vol. II, by kind permission of Professor E. S. 
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TABLES 623 


TABLE III TABLE or Eso. os AND THE CORRESPONDING VaLvEs or Pn (Continued) 


a2 à—à“9 E LE e 
0 
222 T — CREER PCM 
Ja E20. 0 
1 1.5 2 2.5 3 4 5 6 7 8 
2 0.966 | 0.888 | 0.817 | 0.726 0.624 | 0.519 | 0.324 | 0.177 0.084 | 0.035 | 0.013 
4 0.832 | 0.830 | 0.670 | 0.468 0.278 | 0.139 | 0.020 | 0.001 
6 0.704 | 0.791 | 0.574 | 0.326 0.139 | 0.044 | 0.002 
7 0.651 | 0.776 | 0.540 | 0.283 0.106 | 0.028 
8 0.604 | 0.764 | 0:513 | 0.251 0.084 | 0.018 
9 0.563 | 0.754 | 0.491 | 0.226 0.068 | 0.013 
10 0.527. | 0.745 | 0.472 | 0.206 0.057 | 0.010 
11 0.495 | 0.738 | 0.457 | 0.190 0.049 | 0.008 
12 0.466 | 0.731 | 0.444 | 0.178 0.043 | 0.006 
13 0.440 | 0.726 | 0.433 | 0.167 0.038 | 0.005 
14 0.418 | 0.721 | 0.422 0.158 | 0.035 | 0.004 
15 0.397 | 0.716 | 0.414 0.151 | 0.032 | 0.004 
16 0.378 | 0.712 | 0.406 0.144 | 0.029 | 0.003 
17 0.361 | 0.709 | 0.399 0.139 | 0.027 | 0.003 
18 0.345 | 0.705 | 0.393 0.134 | 0.025 | 0.002 
19 0.331 | 0.702 | 0.388 | 0.130 0.024 | 0.002 
20 | 0.317 | 0.700 | 0.383 0.126 | 0.022 | 0.002 
21 0.305 | 0.697 | 0.379 0.123 | 0.021 | 0.002 
22 0.294 | 0.695 | 0.375 0.119 | 0.020 | 0.002 
23 0.283 | 0.693: | 0.371 | 0.117 0.019 | 0.002 
24 0.27: 0.691 | 0.367 | 0.114 0.019 | 0.001 
25 0.264 | 0.689 | 0.364 0.112 | 0.018 | 0.001 
26 0.255 | 0.687 | 0.361 | 0 110 | 0.017 | 0.001 
27 0.248 | 0.686 | 0.359 0.108 | 0.017 | 0.001 
28 | 0.240 | 0.684 | 0.356 0.106 | 0.016 | 0.001 
29 | 0.233 0.683 0.354 0.105 | 0.016 | 0.001 
30 0.226 | 0.682 | 0,352 0.103 | 0.015 | 0.001 
60 | 0,121 | 0.662 0.320 | 0.083 | 0.010 0.001 
* 0.042 | 0.289 | 0.067 0.007 
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TABLES 625 


Tapte III TanLE or E^,os AND THE CORRESPONDING VALUES or Pn (Continued) 


11 * 5 
$ 
h | Eoo 
Mas. 1.5 3- (| o8, | 8 4 5 6 rs 

2 | 0.980 | 0.804 | 0.828 | 0.745 | 0.649 | 0.549 | 0.359 | 0.207 | 0.106 | 0.048 | 0.019 
4 | 0.887 | 0.835 | 0.675 | 0.473 | 0.280 | 0.138 | 0.020 | 0.001 
6 |0.785 | 0.790 | 0.561 | 0.304 | 0.119 | 0.033 | 0.001 

7 |0.739 | 0.772 | 0.519 | 0.251 | 0.082 | 0.018 

8 | 0.697 | 0.756 | 0.483 | 0.211 | 0.059 | 0.010 

9 |0.659 | 0.743 | 0.454 | 0.181 | 0.044 | 0.006 

10 |0.625 | 0.731 | 0.429 | 0.158 | 0.033 | 0.004 

11 |0.593 | 0.720 | 0.408 | 0.140 | 0.026 | 0.002 

12 |0.564 | 0.711 | 0.390 | 0.125 | 0.021 | 0.002 

13 | 0.588 | 0.703 | 0.374 | 0.113 | 0.017 | 0.001 

14 | 0.514 | 0.695 | 0.360 | 0.108 | 0.015 | 0.001 

15 | 0.492 | 0.689 | 0.348 | 0.095 | 0.012 | 0.001 

16 | 0.471 | 0.683 | 0.338 | 0.088 | 0.011 | 0.001 ' 
17 | 0.452 | 0.678 | 0.328 | 0.083 | 0.009 

18 | 0.435 | 0.673 | 0.320 | 0.078 | 0.008 

19 | 0.419 | 0.668 | 0.312 | 0.073 | 0.007 

20 | 0.404 | 0.664 | 0.305 | 0.069 | 0.007 

21 | 0.390 | 0.660 | 0.299 | 0.066 | 0.006 

22 | 0.377 | 0.656 | 0.294 | 0.063 | 0.006 

28 | 0.365 | 0.653 | 0.288 | 0.060 | 0.005 

24 | 0.353 | 0.650 | 0.284 | 0.058 | 0.005 

25 | 0.342 | 0.647 | 0.279 | 0.056 | 0.005 

26 |0.332 | 0.044 | 0.275 | 0.054 | 0.004 

27 |0.323 | 0.642 | 0.272 | 0.052 | 0.004 

28 | 0.314 | 0.640 | 0.268 | 0.050 | 0.004 

29 | 0.305 | 0.637 | 0.265 | 0.049 | 0.003 

30 | 0.297 | 0.635 | 0.262 | 0.048 | 0.003 

60 |0.105 | 0.604 | 0.219 | 0.031 | 0.001 

* 0.567 | 0.177 | 0.019 | 0.001 
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Taste III TABLE or E?^yos AND THE CORRESPONDING VALUES OF Py (Continued) 


he6 


2 | 0.983 | 0.895 | 0.831 | 0.749 | 0.656 | 0.557 | 0.368 | 0.216 | 0.112 | 0.052 | 0.022 
4 0.902 | 0.836 | 0.677 | 0.473 | 0.280 | 0.138 | 0.019 | 0.001 
6 | 0.811 | 0.789 | 0.556 | 0.296 | 0.113 | 0.030 | 0.001 
7 | 0,768 | 0.769 | 0.510 | 0.239 | 0.074 | 0.015 

8 | 0.729 | 0.753 | 0.472 | 0.198 | 0.051 | 0.008 

9 | 0.692 | 0.738 | 0.440 | 0.166 | 0.037 | 0.005 

10 | 0.659 | 0.725 | 0.412 | 0.142 | 0.027 | 0.003 

11 0.628 | 0.713 | 0.389 | 0.123 | 0.020 | 0.002 

12 | 0.600 | 0.702 | 0.369 | 0.108 | 0.016 | 0.001 

13 | 0.574 | 0.693 | 0.351 | 0.096 | 0.012 | 0.001 

14 | 0.550 | 0.685 | 0.336 | 0.086 | 0.010 | 0.001 

15 | 0.527 | 0.677 | 0.323 | 0.078 | 0.008 

16 0.507 0.669 | 0.311 | 0.071 | 0.007 

17 | 0.488 | 0.663 | 0.301 | 0.065 | 0.006 

18 | 0.470 | 0.657 | 0.291 | 0.061 | 0.005 

19 | 0.454 | 0.652 | 0.283 | 0.056 | 0.004 

20 | 0.438 | 0.648 | 0.276 | 0.053 | 0.004 

21 0.424 | 0.644 | 0.269 | 0.050 | 0.003 

22 | 0.410 | 0.639 | 0.262 | 0.047 | 0.003 

23 0.397 | 0.635 | 0.257 | 0.045 | 0.003 

24 0.385 | 0.632 | 0.252 | 0.043 | 0.003 

25 | 0.374 | 0.629 | 0.247 | 0.041 | 0.002 

26 | 0.363 | 0.625 | 0.242 | 0.039 | 0.002 

27 | 0.353 | 0.623 | 0.238 | 0.037 | 0.002 

28 | 0.344 | 0.620 | 0.234 | 0.036 | 0.002 

29 0.335 | 0.617 | 0.231 | 0.034 | 0.002 

30 | 0.326 | 0.615 | 0.228 | 0.033 | 0.002 

60 | 0.184 | 0.576 | 0.181 | 0.019 | 0.001 

LI 0.532 | 0.138 | 0.010 
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Tase III TABLE or Eo AND THE CORRESPONDING VanuEs Or Prr (Continued) 


22 
* 
h E*55.08 | qx Qu tS OU, Oe ee Et 
1 15 2 25 3 4 5 6 7 8 
2 | 0.986 | 0.896 | 0.833 | 0.753 | 0.660 | 0.563 | 0.374 | 0.222 | 0.117 | 0.055 | 0.023 
4 |0.914 | 0.837 | 0.678 | 0.474 | 0.280 | 0.138 | 0.019 | 0.001 
6 |0.831 | 0.788 | 0.552 | 0.289 | 0.108 | 0.028 | 0.001 
7 |0.791 | 0.767 | 0.503 | 0.230 | 0.068 | 0.013 
8 | 0.754 | 0.749 | 0.462 | 0.187 | 0.046 | 0.007 
9 [0.719 | 0.733 | 0.427 | 0.154 | 0.031 | 0.004 
10 | 0.687 | 0.719 | 0.398 | 0.129 | 0.022 | 0.002 
11 | 0.657 | 0.706 | 0.373 | 0.110 | 0.016 | 0.001 
12 | 0.630 | 0.695 | 0.351 | 0.094 | 0,012 | 0.001 
13 | 0.604 | 0.684 | 0.332 | 0.082 | 0.009 
14 | 0.580 | 0.675 | 0.316 | 0.073 | 0.007 i 
15 | 0.558 | 0.667 | 0.301 | 0.065 | 0.006 
16 | 0.538 | 0.659 | 0.289 | 0.058 | 0.005 \ 
17 | 0.518 | 0.652 | 0.277 | 0.053 | 0.004 
18 | 0.501 | 0.645 | 0.267 | 0.048 | 0.003 
19 | 0.484 | 0.639 | 0.258 | 0.044 | 0.003 
20 | 0.468 | 0.634 | 0.250 | 0.041 | 0.002 
21 | 0.453 | 0.629 | 0.243 | 0.038 | 0.002 
22 | 0.439 | 0.624 | 0.236 | 0.036 | 0.002 
23 | 0.426 | 0.619 | 0.230 | 0.034 | 0.002 
24 | 0.414 | 0.615 | 0.224 | 0.032 | 0.001 
25 | 0.402 | 0.611 | 0.219 | 0.030 | 0.001 
26 |0.391 | 0.607 | 0.215 | 0.028 | 0.001 
27 | 0.381 | 0.604 | 0.210 | 0.027 | 0,001 
28 | 0.371 | 0.601 | 0.206 | 0.026 | 0.001 
29 | 0.362 | 0.598 | 0.202 | 0.024 | 0.001 
30 | 0.353 | 0.595 | 0.199 | 0.023 | 0.001 
60 | 0.202 | 0.550 | 0.150 | 0.012 
5 0.498 | 0.105 | 0.005 
d — S E 
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Taste III TABLE or Eio. os AND THE CORRESPONDING VALUES or Pry (Continued) 
4-8 


$ 
1 1.5 2 2.5 3 4 5 6 7 8 
i 0.897 | 0.835 | 0.755 | 0.664 | 0.567 | 0.380 | 0.227 | 0.121 | 0.087 0.024 
: ; 0.838 | 0.678 | 0.474 | 0.279 | 0.137 | 0.019 | 0.001 
à 0.787 | 0.548 | 0.284 | 0.103 | 0.026 | 0.001 
: 0.765 | 0.497 | 0.222 | 0.064 | 0.012 
j 0.746 | 0.454 | 0.178 | 0.041 | 0.006 
0.729 | 0,417 | 0.144 | 0.028 | 0.003 
9.711 | 0.714 | 0.386 | 0.119 | 0.019 | 0.001 
0.682 | 0.700 | 0.359 | 0.099 | 0.013 | 0.001 
0.655 | 0.688 | 0.336 | 0.084 | 0.009 
A 0.630 | 0.677 | 0.316 | 0.072 | 0.007 
0.607 | 0.666 | 0.298 | 0.062 | 0.005 
0.585 | 0.657 | 0.283 | 0.055 | 0.004 
0.564 | 0.648 | 0.269 | 0.048 | 0.003 
0.545 | 0.641 | 0.257 | 0.043 | 0.003 
0.527 | 0.634 | 0.247 | 0.039 | 0.002 
0.510 | 0.627 | 0.237 | 0.035 | 0.002 
0.495 | 0.620 | 0.228 | 0.032 | 0.001 
0.480 | 0.615 | 0.220 | 0.030 | 0.001 
0.466 | 0.609 | 0.213 | 0.027 | 0.001 
0.452 | 0.604 | 0.207 | 0.025 | 0.001 
0.440 | 0.000 | 0.201 | 0.024 | 0.001 
0.428 | 0.595 | 0.196 | 0.022 | 0.001 
0.417 | 0.591 | 0.191 | 0.021 | 0.001 
27 | 0.406 | 0.588 | 0.186 | 0.020 | 0.001 
28 | 0.396 | 0.584 | 0.182 | 0.019 
29 | 0.386 | 0.581 | 0.178 | 0.018 
30 | 0.377 | 0.578 | 0.175 | 0.017 
60 | 0.219 | 0.527 | 0.125 | 0.008 
- 0.466 | 0.081 | 0.003 
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